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Army  Project  Number 
2O465803D730 


Personnel  and  Training 
Analysis  Activities 


FOREWORD 


Assigning  tens  of  thousands  of  Army  recruits  per  year  to  job  training  for  which  they  are 
best  suited  and  in  ways  that  maximize  aggregate  Soldier  performance  represents  a  major 
challenge.  The  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences  (ARI)  has  a 
long  history  of  conducting  and  supporting  research  aimed  at  improving  the  Army’s  selection  and 
classification  process.  In  that  process  potential  recruits  take  the  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB),  from  which  nine  Aptitude  Area  (AA)  composites  are  calculated  for 
selection  and  classification  of  recruits  into  entry-level  jobs.  Until  recently,  each  AA  composite 
was  built  from  four  (of  the  nine)  ASVAB  subtests.  In  January  2002,  the  Army  adopted  fractional 
weights  based  on  a  defensible  performance  criterion.  This  allowed  all  subtests  to  contribute  to 
all  composites  in  proportion  to  their  power  to  “explain”  Soldier  performance.  An  ARI  contractor 
research  team  had  developed  these  composites  as  part  of  a  larger  research  program  into 
improving  military  classification  systems. 

The  purpose  of  the  present  study  was  to  independently  replicate  and  document  the 
Zeidner,  Johnson,  and  colleagues’  method  for  estimation  of  the  nine  (as  well  as  alternative) 
composites  comprising  the  proposed  classification  system,  as  a  prerequisite  to  their  subsequent 
evaluation  (reported  separately).  The  present  study  successfully  reproduced  the  composites 
previously  reported.  These  findings  support  the  operational  use  of  the  nine  composites,  as  well 
as  the  alternative  composites,  in  future  research  and  policy  analysis  aimed  at  evaluating  the 
potential  benefits  of  the  proposed  classification  system  for  improving  Army-wide  classification 
and  assignment. 


BARBARA  A.  BLACK 
Acting  Technical  Director 
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REPLICATION  OF  ZEIDNER,  JOHNSON,  AND  COLLEAGUES’  METHOD  FOR 
ESTIMATING  ARMY  APTITUDE  AREA  (AA)  COMPOSITES 

EXECUTIVE  SUMMARY 


Research  Requirement: 

To  select  and  classify  recruits  to  job  training,  the  Army  employs  nine  Aptitude  Area 
(AA)  composites.  Effective  January  2002,  the  Army  adopted  a  set  of  nine  AA  composites  based 
on  empirically  estimated  weights.  Developed  by  Zeidner,  Johnson,  and  colleagues  (Zeidner, 
Johnson,  Vladimirsky,  &  Weldon,  2000,  2001),  with  support  from  ARI,  these  composites  were 
part  of  a  proposed  two-tiered  classification  system  designed  to  substantially  enhance  the 
classification  potential  of  the  Army’s  AA  composites.  The  purpose  of  the  present  study  was  to 
independently  replicate  and  document  Zeidner,  Johnson,  and  colleagues’  method  of  deriving  the 
composites,  in  particular  the  nine  AA  composites  currently  in  operational  use  as  well  as  the 
alternative  17  and  150  composites  comprising  the  two-tiers  of  the  proposed  system.  Replication 
was  undertaken  as  a  prerequisite  to  subsequent  evaluation  of  these  composites  (reported 
separately). 

Method: 

The  present  study  replicated  Zeidner,  Johnson,  and  colleagues’  method  using  the  same 
Skills  Qualification  Test  (SQT)  database  ( N  =  257,810)  and  affiliated  data  used  by  Zeidner  et  al. 
(2000, 2001)  to  generate  the  AA  composites.  This  procedure  involved:  (1)  correcting  ASVAB 
subtest-SQT  validities  for  criterion  unreliability  and  multivariate  range  restriction  by  MOS;  (2) 
aggregating  corrected  ASVAB  subtest-SQT  validities  by  job  family;  (3)  using  the  aggregated 
ASVAB  subtest-SQT  validities,  empirically  estimating  population  beta  weights  for  each  job 


family;  (4)  converting  population  beta  weights  (from  Step  3)  to  unstandardized  b-weights  and 
constants;  and  (5)  transforming  these  unstandardized  b-weights  and  constants  to  operational 
weights  and  constants  for  computing  AA  standard  scores. 

Findings: 

Overall,  we  were  able  to  reproduce  both  population  beta  weights  and  operational  weights 
(and  constants)  for  the  9, 17,  and  150  composites  previously  reported  by  Zeidner  et  al.  (2000, 
2001)  with  one  exception.  The  single  exception  was  associated  with  the  Clerical  Administration 
1  (CL1)  composite  in  the  17  job  family  configuration  comprising  Zeidner,  Johnson,  and 
colleagues’  second  tier.  This  difference  owes  to  Zeidner  et  al.’s  (2000, 2001)  particular 
implementation  of  the  recommended  procedure  for  deriving  the  best  set  of  positive  weights. 

Use  of  Findings: 

Our  results  validate  the  Zeidner,  Johnson,  and  colleagues’  method  for  deriving  AA 
composite  weights,  including  the  AA  composite  weights  currently  in  operational  use  by  the 
Army.  The  present  study  represents  an  independent  verification  of  their  method  and  previously 
reported  results.  These  findings  support  the  use  of  these  composites  in  future  research  and  policy 
analysis  evaluating  the  proposed  two-tiered  classification  system. 
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INTRODUCTION 


Background 

To  select  and  classify  recruits  to  job  training,  the  Army  employs  nine  Aptitude  Area 
(AA)  composites.  Each  composite  represents  a  differentially  weighted  function  of  aptitudes  and 
skills  required  for  successful  performance.  Until  recently,  these  nine  AA  composites  utilized 
unit-weights  (i.e.,  0, 1).  Based  on  rational  linkages  to  job  content,  these  unit  weights  were  meant 
to  reflect  the  relative  importance  of  different  cognitive  aptitudes  and  abilities  (e.g.,  verbal  ability, 
coding  speed,  mechanical  comprehension),  as  measured  by  the  Armed  Services  Vocational 
Battery  (ASVAB),  in  determining  job  performance  within  a  family  of  jobs  (e.g.,  Clerical, 
Combat,  Field  Artillery,  etc.).  These  “original”,  unit-weighted  AA  composites  and 
corresponding  ASVAB  subtests  are  shown  in  Table  1. 


Table  1:  ASVAB  Subtests  Comprising  the  Army’s  “Original”  AA  Composites  and  AFQT 


ASVA] 

B  SUB 

.TESTS 

AR 

MK 

VE 

AS 

El 

GS 

MC 

CS 

NO 

AA  COMPOSITES 

HI 

Electronics  Repair 

X 

X 

X 

X 

II 

General  Maintenance 

X 

X 

X 

X 

HI 

Mechanical  Maintenance 

X 

X 

X 

Operators  /  Food 

X 

X 

X 

EH 

Surveillance  /  Communications 

X 

X 

X 

X 

HI 

Combat 

X 

X 

X 

X 

HI 

Field  Artillery 

X 

X 

X 

X 

Skilled  Technical 

X 

X 

X 

X 

| 

Clerical 

X 

X 

X 

General  Technical 

X 

X 

HI 

AFQT 

X 

X 

XX 

HI 

ASVAB  is  comprised  of  following  subtests:  Arithmetic  Reasoning  (AR),  Math  Knowledge  (MK),  Verbal 
(VE)  =  Paragraph  Comprehension  (PC)  +  Word  Knowledge  (WK),  Auto  &  Shop  Information  (AS), 
Electronics  Information  (El),  General  Science  (GS),  Mechanical  Comprehension  (MC),  Coding  Speed 
(CS),  Numerical  Operations  (NO). 
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Starting  in  January  2002,  the  Army  adopted  a  set  of  nine  AA  composites  based  on 
empirically  estimated  beta  weights,  corrected  to  the  Youth  population,  for  a  7  ASVAB  test 
battery  (Greenston,  Rumsey,  Zeidner,  &  Johnson,  2001).1  The  ASVAB  subtest  weights  that 
define  the  AA  composites  are  shown  in  Table  2.  These  composites  were  developed  by 


Table  2:  ASVAB  Subtest  (Relative)  Weights  Comprising  the  AA  Composites 


ASVAB  Subtests 

AR 

MK 

VE 

AS 

El 

GS 

MC 

AA  COMPOSITES 

Electronics  Repair 

.818 

.890 

1.000 

.754 

.598 

.151 

.469 

General  Maintenance 

.828 

.794 

.417 

1.000 

.577 

.411 

.503 

Mechanical  Maintenance 

.339 

.289 

.237 

1.000 

.340 

.060 

.394 

Operators  /  Food 

.962 

.600 

.714 

1.000 

.377 

.251 

.636 

Surveillance  /  Communications 

.685 

1.000 

.915 

.437 

.551 

.019 

.386 

Combat 

.532 

1.000 

.529 

.733 

.343 

.313 

.595 

Field  Artillery 

.715 

1.000 

.586 

.673 

.297 

.249 

.700 

Skilled  Technical 

.727 

.697 

1.000 

.357 

.230 

.187 

.446 

Clerical 

1.000 

.767 

.980 

.110 

.110 

.000 

.148 

Zeidner,  Johnson,  and  colleagues  (Zeidner,  Johnson,  Vladimirsky,  &  Weldon,  2000,  2001),  with 
support  from  the  Army  Research  Institute  (ARI),  as  part  of  a  proposed  two-tiered  classification 
system.2  Within  this  system,  first  tier  composites  are  intended  for  classifying  recruits  to  one  of 
150  entry-level  job  families.  The  second  tier  composites,  aimed  at  a  smaller  set  of  job  families 
(9  or  17),  are  meant  for  recruiting,  vocational  counseling,  and  administration  puxposes.  A 
program  of  research  conducted  by  Zeidner,  Johnson,  and  colleagues  using  large-scale 
simulations  demonstrated  that  the  proposed  two-tiered  classification  system  and  related 


1  DoD  initiated  a  design  change  to  reduce  the  scope  of  the  ASVAB,  from  nine  to  seven  subtests,  that  was 
implemented  in  January  2002.  Numerical  Operations  (NO)  and  Coding  Speed  (CS)  were  deleted  from  the  battery, 
for  the  purpose  of  facilitating  uniform  administration  of  the  test  battery,  but  at  a  significant  reduction  in  potential 
classification  efficiency. 

2  In  descriptions  of  the  Zeidner,  Johnson,  and  colleagues’  method,  these  weights  are  frequently  referred  to  as  least 
squares  estimates  (LSE)  or  LSE  weights,  as  the  weights  are  empirically  estimated  using  conventional  ordinary  least- 
squares  (OLS)  regression. 
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composites  would  produce  substantial  gains  in  aggregate  Soldier  performance  over  the  Army’s 
previous  system  of  unit-weighted  composites  (Johnson,  Zeidner,  &  Leaman,  1992;  Statman, 
1993;  Zeidner  et  al.,  2000,  2001). 

The  purpose  of  the  present  study  is  to  independently  replicate  and  document  the  Zeidner, 
Johnson,  and  colleagues’  method  of  deriving  the  composites  for  their  proposed  two-tiered 
classification  system,  in  particular  the  nine  AA  composites  currently  in  operational  use3,  as  a 
prerequisite  for  subsequent  evaluation  of  the  system  (reported  separately).  More  specifically,  the 
present  study  seeks  to  replicate  their  method  and  previously  reported  results  (Zeidner  et  al., 

2000, 2001)  for  the  9, 17,  and  150  composites  comprising  the  two-tiers  of  this  proposed  system. 
For  all  composites,  this  includes  both  the  empirically  estimated  population  beta  weights  and  the 
operational  weights  (and  constants)  for  computing  AA  standard  scores  used  by  the  Army  when 
making  personnel  and  training  decisions.4  Our  replication  of  the  Zeidner,  Johnson,  and 
colleagues’  method  is  based  on  technical  reports  describing  their  method  (Greenston  et  al.,  2001; 
Zeidner  et  al.,  2001, 2003a,  2003b),  supplemented  with  information  contained  in  their  original 
programs.  All  SAS  programs,  with  documentation,  used  in  our  replication  can  be  found  in 
Appendix  A.  The  original  programs  implementing  the  Zeidner,  Johnson,  and  colleagues’ 
method,  also  with  documentation,  can  be  found  in  Appendix  B. 


3  Given  the  importance  of  the  change  from  unit-weighted  to  LSE  composites,  ARI  undertook  an  independent  study 
to  confirm  the  results  of  the  original  research  and  to  provide  a  well-documented  record  of  the  methodology. 

4  Zeidner,  Johnson,  and  colleagues  refer  to  these  operational  weights  as  “u,  k  values”  or  “transformation  weights”,  as 
they  reflect  linear  transformations  of  the  population  beta  weights  to  weights  that  standardize  AA  scores  to  have  a 
mean  of  100  and  a  standard  deviation  (SD)  of  20. 
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METHOD 


Data 

The  present  study  employs  the  same  Skills  Qualification  Test  (SQT)  program  database 
used  by  Zeidner,  Johnson,  and  colleagues  (Zeidner  et  al.,  2000, 2001, 2003a,  2003b).  This 
database  contains  ASVAB  subtest  scores  and  standardized  SQT  scores  for  FYs  1987-1989  (N  = 
257,8 10).5  Running  from  1983  to  1991,  the  SQT  was  a  comprehensive  program  for  assessing 
enlisted  Soldiers’  job  proficiency  for  purposes  of  advancement  and  promotion.  Under  this 
program,  Soldiers  were  required  to  take  the  SQT  annually  after  completing  11  months  or  more  of 
service.  SQT  were  work  samples  or  paper-and-pencil  job  knowledge  tests.  Each  SQT  was 
specific  to  a  military  occupational  specialty  (MOS).  These  data  were  originally  collected  and 
made  available  by  ARI.  Basic  descriptives,  and  the  ASVAB  variance-covariance  matrix,  for  the 
full  sample  are  reported  in  Appendix  C. 


Procedure 

As  an  overview,  the  Zeidner,  Johnson,  and  colleagues  method  consists  of  the  following 

steps: 

•  Step  1:  Correct  ASVAB  subtest-SQT  validities  for  criterion  unreliability  and 
multivariate  range  restriction  by  MOS. 

•  Step  2:  Aggregate  ASVAB  subtest-SQT  validities  by  job  family. 

•  Step  3:  Using  the  aggregated  ASVAB  subtest-SQT  validities,  empirically  estimate 
population  beta  weights  for  each  job  family. 


5  To  ensure  comparability  across  MOS,  SQT  scores  were  standardized  to  have  a  mean  of  0  and  an  SD  of  1. 
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•  Steps  4  and  5:  Transform  population  beta  weights  (from  Step  3)  to  operational 
weights  (and  constants)  for  computing  AA  standard  scores. 

Our  goal  was  to  replicate  the  above  steps,  and  their  implementation,  so  as  to  reproduce 
the  composite  validities  and  weights  previously  reported  by  Zeidner,  Johnson,  and  colleagues 
(Zeidner  et  al,  2000,  2001, 2003a).  Technical  details  related  to  each  step,  and  our  replication,  are 
summarized  in  turn. 

Step  1:  Correct  ASVAB  Subtest-SQT  Validities  for  Criterion  Unreliability  and  Multivariate 
Range  Restriction  by  MOS 

Consistent  with  the  current  psychometric  literature  (e.g.,  Cohen,  Cohen,  West,  &  Aiken, 
2002;  Guion,  1998;  Hunter  &  Schmidt,  1990;  Ree,  Carretta,  Earles,  &  Albert,  1994;  Sackett  & 
Yang,  2000;  Schmidt  &  Hunter,  1996),  the  goal  of  this  step  is  to  correct  observed  validities  for 
statistical  artifacts  (criterion  unreliability,  range  restriction)  that  downwardly  bias  validities  and 
related  estimates  (e.g.,  beta  weights).  In  keeping  with  recommendations  regarding  the  order  of 
these  corrections  (Hunter,  Schmidt,  &  Le,  2002;  Stauffer  &  Mendoza,  2001),  criterion  reliability 
was  corrected  first,  followed  by  range  restriction.  Using  a  variation  of  the  standard  correction 
for  attenuation  formula,6 

_  _  rxy 

^44,’  (1) 

observed  ASVAB-SQT  validities  (rxy)  were  corrected  by  MOS  for  criterion  unreliability  (ryy). 
Criterion  reliabilities  used  in  these  corrections  reflect  internal  consistency  reliabilities, 
specifically  coefficient  alphas  (Cronbach,  1951).  The  reliabilities  employed  in  our  corrections 
were  the  same  as  those  used  by  Zeidner  et  al.  (2000,  2001)  and  are  reported  in  Appendix  D. 
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After  correcting  for  criterion  unreliability,  ASVAB-SQT  validities  were  corrected  for 
multivariate  range  restriction  by  MOS  using  formulas  originally  developed  by  Aitken  (1934)  and 
Lawley  (1943),  and  described  by  Gulliksen  (1950),  and  Bimbaum,  Paulson,  and  Andrews 
(1950).  Large-scale  simulations  demonstrate  that,  when  applied  appropriately,  the  Aitken- 
Lawley  corrections  consistently  produce  estimates  that  closely  approximate  validities  for  the 
relevant  reference  population  (Sackett  &  Yang,  2000).  The  Aitken-Lawley  multivariate  range 
restriction  correction  formulas  are  most  appropriate  for  this  case  because  selection  to  an  MOS 
results  from  multiple  variables  (e.g.,  ASVAB  subtests)  (Ree  et  al.,  1994;  Sackett  &  Young, 
2000). 

The  multivariate  range  restriction  correction  formulas  were  applied  to  the  validities  twice 
to  obtain  two  separate  sets  of  corrected  ASVAB  subtest-SQT  validities.  First,  to  produce 
ASVAB  subtest-SQT  validities  corrected  to  the  Army  Input  population,  and  the  second  time,  to 
produce  validities  corrected  to  the  Youth  population.  The  two  sets  of  corrections  were  necessary 
as  the  relevant  reference  population,  and  thereby  the  factors  (or  variables)  restricting  the 
validities,  differs  for  the  two  tiers  in  Zeidner,  Johnson,  and  colleagues’  proposed  classification 
system.  For  purposes  of  the  first  tier,  the  relevant  reference  population  is  the  Army  Input 
population,  so  observed  ASVAB  subtest-SQT  validities  are  restricted  by  formal  classification 
effects  and  eligible  recruits’  self-selection  to  an  MOS,  For  the  second  tier,  the  relevant  reference 
population  is  the  Youth  population,  so  observed  validities  are  doubly  restricted  by  both  formal 
selection  (e.g.,  AFQT)  and  classification  effects,  as  well  as  prospective  recruits’  self-selection 
into  the  Army. 


6  Unless  otherwise  specified,  notation  used  throughout  this  report  follows  that  of  Cohen  et  al.  (2003). 
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Corrections  were  made  to  obtain  the  variance-covariance  (VCV)  matrix  (v)  for  the 
relevant  reference  population  shown  below  (using  a  variation  of  the  conventional  Bimbaum, 
Paulson,  &  Andrews  [1950]  notation,  cf.,  Ree  et  al.  [1994];  Sackett  &  Yang  [2000]): 

Tv**  V*yl 

[Vy*  Vyyj'  (2) 

where  v«  is  known  and  denotes  the  unrestricted  (or  population)  VCV  matrix  for  all  9  ASVAB 
subtests;  v^(or  its  transpose,  v**)  is  unknown  and  denotes  the  estimate  of  the  corrected  ASVAB 
subtest-SQT  covariances  in  the  relevant  reference  population;  and  vyy  is  unknown  and  denotes 
the  estimate  of  the  corrected  SQT  variance  in  the  relevant  reference  population.  To  obtain  the 
corrected  ASVAB  subtest-SQT  validities,  we  did  the  following.  First,  using  the  known 
unrestricted  (or  population)  variances  for  all  9  ASVAB  subtests  (including  NO  and  CS)  and  the 
known  ASVAB  variances  and  ASVAB  subtest-SQT  covariances  (corrected  for  criterion 
unreliability)  from  a  restricted  MOS  sample,  we  estimated  the  ASVAB-SQT  covariances 
corrected  to  the  relevant  reference  population  (Army  Input  or  Youth).7  Second,  we  derived  the 
SQT  variances  for  each  MOS  corrected  to  the  relevant  reference  population.  At  this  point,  we 
had  the  complete  variance-covariance  matrix  corrected  to  the  relevant  reference  population  for 
all  155  MOS.  Third,  and  finally,  we  converted  the  corrected  variance-covariance  matrices  for 
each  MOS  to  ASVAB  subtest-SQT  validities,  reflecting  the  range-restricted  corrected  validities 
for  the  current  operational  ASVAB  battery  of  7  subtests  (dropping  NO  and  CS). 

It  should  be  noted  that  including  information  on  the  full  9  ASVAB  subtests  in  the 
correction  procedure,  even  though  the  current  battery  only  contains  7  (minus  NO  and  CS),  is 
necessary  to  ensure  that  the  range-restriction  corrected  validities  are  accurate.  This  is  because 
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NO  and  CS  are  involved  in  restricting  the  variance  of  SQT  scores  in  the  MOS  samples,  which 
thereby  lowers  the  observed  ASVAB  subtest-SQT  validities.  In  order  to  accurately  recover  the 
unknown  population  (Army  Input  or  Youth)  variance  of  SQT  prior  to  the  selection  and 
classification  effects  underlying  the  MOS  samples,  NO  and  CS  need  to  be  accounted  for,  as  done 
in  the  Zeidner,  Johnson,  and  colleagues’  procedure. 

After  applying  the  above  correction  procedures,  we  had  two  sets  of  ASVAB  subtest-SQT 
validities  corrected  for  criterion  unreliability  and  range  restriction  for  155  MOS;  one  set 
reflecting  validities  corrected  to  the  Army  Input  population,  and  the  second  set  reflecting 
validities  corrected  to  the  Youth  population.  As  an  interim  step,  we  verified  our  results  against 
the  corrected  validities  reported  by  Zeidner,  Johnson,  and  colleagues  (2003a). 


Step  2:  Aggregate  ASVAB  Subtest-SQT  Validities  by  Job  Family 

The  goal  of  this  step  is  to  aggregate  the  corrected  ASVAB  subtest-SQT  validities  (from 
Step  1)  by  job  family  for  empirically  estimating  the  population  beta  weights  derived  in  Step  3. 
The  procedure  for  aggregating  these  corrected  validities  to  form  a  weighted  average  for  each  job 
family  can  be  summarized  in  the  formula  below: 


—  _  Z(A> ri) 

(3)  ■ 

where  n  represents  the  acquisition  number  for  each  MOS;  that  is,  the  number  of  Army  recruits  to 
be  allocated  to  an  MOS.  As  evident  from  the  formula,  this  procedure  is  directly  analogous  to 
conventional  meta-analytic  procedures  in  applied  psychology  for  aggregating  validities  across 
research  samples  (e.g..  Hunter  &  Schmidt,  1990).  Likewise,  the  procedure  is  comparable  to  the 


7  In  Zeidner,  Johnson,  and  colleagues’  description  of  their  method  (Zeidner  et  al.,  2001, 2003a,  2003b),  this  is 
referred  to  as  the  Youth  Population  criterion  variance  (YPCV), 
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traditional  method  in  statistics  of  pooling  averages  across  multiple  samples.  A  conceptual 
description  of  this  aggregation  procedure  follows. 

For  each  MOS,  we  multiplied  the  corrected  ASVAB  subtest-SQT  validities  (the  ps  from 
Step  1)  separately  by  their  respective  acquisition  numbers  (n).  The  resulting  products  (of  the 
SQT  validities  and  the  acquisition  numbers)  for  each  ASVAB  subtest  were  then  summed  across 
all  MOS  corresponding  to  a  particular  job  family,  as  were  the  applicable  acquisition  numbers. 

To  obtain  the  final  aggregated  job  family-level  validities,  we  then  divided  the  sum  of  the  n- 
weighted  ASVAB-SQT  validities  for  a  given  job  family  (£,&>,«),  by  the  respective  sum  of  MOS 

acquisition  numbers  (]T n  )• 

The  acquisition  numbers  (n)  used  in  our  replication  are  exactly  the  same  as  the  numbers 
employed  by  Zeidner,  Johnson,  and  colleagues.  These  numbers,  which  are  reported  in  Appendix 
E,  were  based  on  available  assignment  and  classification  data  from  the  Seabrook  Reports  (1989). 
Multiplying  MOS  validities  by  their  respective  acquisitions  numbers  ensures  that  the 
contribution  of  an  MOS  to  the  estimation  of  job  family-level  beta  weights  accurately  reflects  its 
operational  importance  to  Army  assignment  and  classification  policy.  The  job  family 
configurations  used  in  our  replication  match  the  configurations  proposed  by  Zeidner,  Johnson, 
and  colleagues,  for  the  new  two-tiered  classification  system,  which  were  previously  reported  in 
Zeidner  et  al.  (2001). 

Upon  completing  this  step,  we  had  obtained  the  aggregated  corrected  ASVAB  subtest- 
SQT  validities  ( ps)  necessary  for  empirically  estimating  the  population  beta  weights  (j3s)  in 
Step  3.  We  repeated  this  procedure  three  times,  to  derive  three  different  sets  of  aggregated 
ASVAB  subtest-SQT  validities:  (a)  one  set  corresponding  to  Zeidner,  Johnson,  and  colleagues’ 
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first  tier;  and  (b)  two  sets  corresponding  to  the  second  tier  (one  for  9  job  families  and  a  second 
version  for  17  job  families). 

Step  3:  Using  the  Aggregated  ASVAB  Subtest-SQT  Validities,  Empirically  Estimate  Population 
Beta  Weights  for  Each  Job  Family 

The  primary  goal  of  this  step  is  to  empirically  estimate  population  beta  weights  {0s)  for 

each  job  family  based  on  the  aggregated  ASVAB  subtest-SQT  validities  (ps)  from  the 
preceding  step.  These  weights  become  the  basis  for  the  operational  weights  (and  constants) 
subsequently  derived  in  Steps  4  and  5,  which  are  used  by  the  Army  to  compute  AA  standard 
scores  to  assign  entry-level  recruits  to  an  MOS,  or  for  vocational  counseling  purposes  and  re¬ 
assignment  of  currently  enlisted  Soldiers.  The  current  step  was  motivated  by  a  series  of  large- 
scale  simulations  conducted  by  Zeidner,  Johnson,  and  colleagues  demonstrating  greater 
classification  efficiency  and  aggregate  Soldier  performance  using  AA  composites  based  on 
empirically  estimated  beta  weights  versus  the  existing  unit-weighted  composites  (Zeidner  et  al., 
2000,  2001).  The  procedure  for  estimating  the  population  beta  weights  slightly  differs  by  tier. 

For  the  first  tier,  comprised  of  150  job  families,  population  beta  weights  (0s)  were 
estimated  for  each  job  family  using:  (a)  the  applicable  aggregated  ASVAB  subtest-SQT 
validities  (from  Step  2);  and  (b)  the  ASVAB  subtest  intercorrelation  matrix  for  the  relevant 
reference  population,  the  Army  Input  population.  This  procedure  is  represented  in  the  following 
formula: 

Byx  — '  Rxx  *  Rx W 

For  each  job  family,  a  7  x  1  vector  of  population  beta  weights  {Byx)  was  generated  empirically 
using  standard  ordinary  least  squares  (OLS)  regression  applied  to  a  7  x  7  matrix  of  ASVAB 
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intercorrelations  (/?«),  and  a  7  x  1  vector  of  ASVAB  subtest-SQT  validities  (Ry).  At  the  end  of 


this  estimation  process,  we  had  150  sets  of  population  beta  weights  ( J3s ),  one  set  per  job  family. 
Conceptually,  these  weights  reflected  the  relative,  unique  contribution  of  different  cognitive 
aptitudes  and  abilities,  as  measured  by  the  ASVAB  subtests,  to  job  performance  for  a  family  of 
comparable  jobs. 

For  the  second  tier,  comprised  of  either  9  or  17  job  families,  population  beta  weights 
were  estimated  for  each  job  family  using:  (a)  the  applicable  aggregated  ASVAB  subtest-SQT 
validities  (from  Step  2);  and  (b)  the  ASVAB  subtest  intercorrelation  matrix  for  the  relevant 
reference  population,  in  this  case  the  Youth  population.  Consistent  with  Zeidner,  Johnson,  and 
colleagues,  ASVAB  subtest  intercorrelations  were  based  on  normative  information  for  the  1980 
Youth  population.  In  contrast  to  the  estimation  process  for  the  first  tier,  population  beta  weights 
were  constrained  to  be  positive.  This  was  done  for  operational  purposes,  so  that  poor 
performance  on  a  test,  particularly  due  to  low  motivation  or  deliberate  distortion,  would  not 
significantly  contribute  to  and,  thereby,  bias  assignment  and  classification  decisions.  Otherwise, 
consistent  with  the  first  tier,  population  beta  weights  were  estimated  using  standard  OLS 
regression. 

To  derive  the  “best”  set  of  positive  beta  weights,  where  “best”  is  defined  as  the  subset  of 
positive  beta  weights  yielding  the  highest  multiple  R,  we  did  the  following.  Starting  with  all  7 
ASVAB  subtests,  then  iterating  through  successively  smaller  composites  consisting  of  (m- 1) 
tests,  we  estimated  betas  for  all  possible  subsets.  That  is,  we  estimated  betas  for  all  possible 
subtests  of  7,  then  6,  then  5,  then  4,  etc.,  ASVAB  subtests.  The  stopping  rule  was  reached  when 
we  had  identified  the  “best”  set  of  positive  beta  weights.  Specifically,  these  are  the  beta  weights 
of  the  non-negatively  weighted  composite  with  the  largest  possible  number  of  tests,  say  m*. 
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whose  multiple  R  is  highest  among  all  non-negatively  weighted  composites  with  m*  tests  and,  at 
the  same  time,  higher  than  the  Rs  of  all  possible  composites  with  (m*- 1)  tests.  Once  identified, 
this  set  of  betas  was  outputted,  with  all  excluded  tests  being  assigned  beta  weights  of  0. 

We  carried  out  this  estimation  process  twice,  once  for  the  9  job  families  and  once  for  the 
17  job  families  comprising  Zeidner,  Johnson,  and  colleagues,  second  tier.  At  the  end  of  this 
estimation  process,  we  had  two  full  sets  of  population  beta  weights. 

All  population  beta  weights  for  the  9, 17,  and  150  job  families  estimated  from  our 
replication  are  reported  in  Appendix  F. 

Steps  4  and  5:  Transform  Population  Beta  Weights  (From  Step  3)  to  Operational  Weights  (and 
Constants)  for  Computing  AA  Standard  Scores 

The  goal  for  the  final  two  steps  is  to  transform  population  beta  weights  (from  Step  3)  to 
operational  weights  (and  constants)  for  purposes  of  computing  AA  standard  scores  for  use  by 

Q 

Army  personnel  managers  when  making  classification  and  counseling  decisions.  For  the  first 
tier,  the  operational  weights  are  simply  unstandardized  population  b-weights  and  constants. 
Consistent  with  their  intended  use,  the  operational  weights  for  the  second  tier  are  linearly 
transformed  b-weights  and  constants,  constructed  so  as  to  produce  AA  standard  scores  with  a 
mean  of  100  and  a  standard  deviation  (SD)  of  20,  which  reflect  the  desired  population-level 
characteristics  of  the  relevant  reference  population,  the  Youth  population.  The  Zeidner,  Johnson, 
and  colleagues’  transformation  process,  which  we  replicated,  generally  involves  two  steps. 


8  Readers  are  reminded  that  Zeidner,  Johnson,  and  colleagues  refer  to  these  operational  weights  (and  constants)  as 
“u,  k  values”  or  “transformation  weights”. 
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In  the  first  step,  population  beta  weights  (the  0s  from  Step  3)  are  converted  to 
unstandardized  b-weights  and  constants.  For  each  job  family,  the  population  beta  weights  were 


converted  to  unstandardized  population  b-weights  ( Byx *)  using  the  following  formula: 


(5) 


As  can.be  seen  from  the  formula,  this  conversion  was  carried  out  by  multiplying  each  population 
beta  weight  (0yx)  by  the  ratio  of  the  SQT  standard  deviation  over  the  respective  ASVAB  subtest 

standard  deviation  ^ j .  For  the  first  tier,  the  constants  ( Boy  * )  were  then  derived  using  the 

formula: 

Boy*  ^^(Byx*  filx)  (6) 

where  the  set  of  unstandardized  b-weights  ( Byx  *)  for  a  given  job  family  were  individually 
multiplied  by  their  respective  ASVAB  subtest  population  means  (jUx,  Army  Input),  and  the 
summation  is  across  the  7  ASVAB  subtests.  This  step  effectively  converts  the  population  beta 
weights  back  to  their  original  metric  (or  scale).  For  the  first  tier,  no  additional  conversion  was 
necessary,  as  the  unstandardized  b-weights  and  constants  produced  at  this  step  constitute  the 
operational  weights.  For  the  second  tier,  the  conversion  to  unstandardized  b-weights  permits  the 
subsequent  linear  transformation  of  these  same  weights  (and  constants)  to  an  alternative  standard 
scale  with  the  aforementioned  properties  (mean  of  100,  SD  of  20). 

In  the  second  step,  applicable  only  to  the  second  tier,  the  unstandardized  b-weights  for 
each  job  family  were  transformed  to  their  final  operational  form  using  the  formulas: 

20  (7) 

Byx*  RxxByx*7  ) 

byx  =  CM  (Byx*)  (8) 
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&0y  =  100  -  ]T  (byx  *  50) 


(9) 


The  first  formula  (Eq.  7)  generates  a  composite  multiplier  (CM),  which  standardizes  b-weighted 
AA  scores  to  have  a  SD  of  20.  This  standardization  is  accomplished  through  formula  (Eq.  E), 
which  linearly  transforms  the  unstandardized  b-weights  to  operational  weights  using  CM.  The 
third  and  final  formula  (Eq,  9)  derives  constants  that  center  operational  AA  scores  to  have  the 
desired  mean  of  100.  At  the  end  of  this  second  step,  we  had  the  operational  weights  and 
intercepts  (by  job  family)  for  both  the  9  and  17  composites  comprising  Zeidner,  Johnson,  and 
colleagues’  proposed  second  tier. 

Our  replicated  operational  weights  and  intercepts  for  9, 17,  and  150  composites  are 
reported  in  Appendix  F. 

RESULTS 

Following  the  Zeidner,  Johnson,  and  colleagues’  method,  we  were  able  to  successfully 
reproduce  both  population  beta  weights  and  operational  weights  and  intercepts  for  the  9, 17,  and 
150  composites  previously  reported  by  Zeidner  et  al.  (2000, 2001)  with  one  exception  (see 
Appendix  F  for  our  results).  The  exception  can  be  found  in  the  17  job  family  variation  of 
Zeidner,  Johnson,  and  colleagues’  second  tier,  specifically  with  the  Clerical  Administration  1 
(CL1)  composite  (see  Tables  4  and  5,  Appendix  F). 

Population  beta  weights  reported  for  CL1  (Zeidner  et  al.,  2000,  2001)  were  not  consistent 
with  the  weights  generated  by  our  replication.  The  most  notable  discrepancies  between  the 
Zeidner  et  al.  estimates  (2001)  and  those  produced  from  our  replication  are  associated  with  the 
Arithmetic  Reasoning  (AR)  and  Mathematical  Knowledge  (MK)  subtests.  Specifically,  our 
estimated  population  beta  weights  for  AR  and  MK  were  .24818270  and  .22718282,  respectively; 
whereas  Zeidner  et  al.  (2000,  2001)  reported  betas  of  .00000  (AR)  and  .36801  (MK).  Because 
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there  were  differences  with  the  population  beta  weights,  the  operational  weights  previously 
reported  for  CL1  were  likewise  not  in  agreement  with  the  weights  derived  from  our  replication. 

An  examination  of  the  regression  of  all  possible  subsets  of  ASVAB  subtests  indicates 
that  the  set  originally  derived  by  Zeidner  et  al.  (2000,  2001)  yielded  a  multiple  R  of  .5085  based 
on  4  subtests,  compared  to  our  set  of  best  positive  weights,  which  yielded  a  higher  multiple  R  of 
.5241  based  on  3  subtests.9  This  finding  suggests  that  for  this  particular  composite,  the 
previously  reported  results  are  not  entirely  consistent  with  the  stated  goal  of  the  Zeidner, 
Johnson,  and  colleagues’  (2000, 2001)  method  for  deriving  the  “best”  set  of  positive  weights. 
The  Zeidner  et  al.  results  could  be  viewed  as  advantageous  in  that  the  set  of  weights  generated 
are  based  on  a  larger  number  of  ASVAB  subtests,  although  our  weights  are  consistent  with  the 
goal  of  estimating  the  “best”  set  of  positive  weights  and  produced  a  higher  multiple  R. 
Additionally,  there  is  a  meaningful  relationship  between  our  weights  for  CL1  and  the  weights 
estimated  for  CL  (Clerical  Administration)  at  the  9-composite  level,  such  that  averaging  the 
weights  associated  with  CL1  and  CL2  recover  the  weights  estimated  for  the  CL  composite. 

Other  than  the  CL1  composite,  all  other  replicated  beta  weights  and  operational  weights 
(and  constants)  comprising  the  first  and  second  tier  of  Zeidner,  Johnson,  and  colleagues’ 
proposed  classification  system  matched  exactly  with  previously  reported  estimates. 

DISCUSSION 

Starting  in  January  2002,  the  Army  adopted  a  set  of  nine  AA  composites  based  on 
empirically  estimated  beta  weights,  corrected  to  the  Youth  population,  for  a  7  ASVAB  test 
battery.  Zeidner,  Johnson,  and  colleagues  (Zeidner  et  al.,  2000,  2001)  developed  these 


9  More  specifically,  Zeidner  et  al.  derived  the  best  positive  weights  based  on  four  subtests,  whereas  our  replication  of 
their  method  produced  the  best  weights  among  all  possible  subsets  based  on  3  subtests. 
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“interim”  composites  as  part  of  a  proposed  two-tiered  classification  system.  The  purpose  of  the 
present  study  was  to  independently  replicate  the  Zeidner,  Johnson,  and  colleagues’  method,  and 
implementation  of  their  method,  in  deriving  the  9,  17,  and  150  composites  comprising  their 
proposed  classification  system. 

Overall,  we  successfully  reproduced  both  population  beta  weights  and  operational 
weights  and  constants  for  the  9, 17,  and  150  composites  previously  reported  by  Zeidner  et  al. 
(2000, 2001)  with  one  exception.  The  single  exception  is  associated  with  the  Clerical 
Administration  1  (CL1)  composite  in  the  17  job  family  configuration  of  Zeidner,  Johnson,  and 
colleagues’  second  tier.  Otherwise,  we  fully  replicated  population  beta  weights  and  operational 
weights  (and  constants)  for  all  other  composites  comprising  both  the  first  and  second  tier  of 
Zeidner,  Johnson,  and  colleagues’  proposed  classification  system,  including  the  “interim”  set  of 
nine  AA  composites  currently  in  operational  use  by  the  Army.  These  findings  support  the  use  of 
these  composites  in  future  research  and  policy  analysis  aimed  at  evaluating  the  potential  benefits 
of  the  proposed  two-tiered  classification  system  for  improving  Army- wide  classification  and 
assignment. 
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APPENDIX  A:  PROGRAMS  FOR  REPLICATING  ZEIDNER,  JOHNSON,  AND 

COLLEAGUES’  (2000)  METHOD 


A-l 


Step  1:  Correction  for  Criterion  Unreliability  and  Range  Restriction 


Correction  for  Criterion  Unreliability 

y******************************************************************************* 

Correcting  ASVAB-SQT  validity  coefficients  and  covariances 
for  criterion  unreliability 

*********************** ************************************ ********************y 


libname  DirPath  *D:  \NewAA\"  ; 

y**************************************************************** 

OUTPUT  DATASETS  -  rename  right-hand-side  as  needed 
****************************************************************/ 
% let  Ryx_Correc tRel ib_MOS=DirPath . CorXY ; 

%let  €yx_Correc tRel ib_MQS=Dir Path . CorCV; 

y ******************************************* ********************* 
INPUT  DATASETS 

****************************************************************y 
%let  Descr iptive_MOS=DirPath . Descrip ; 

%let  R_Samp_MOS=DirPath . Corr ; 

/*  variable  names  for  ASVAB  subtests  */ 

%let  TESTNAME S=GS  AR  NO  CS  AS  MK  MC  El  VE; 


proc  iml? 

TestNames  =  {&TESTNAMES} ; 

/*  Read  ASVAB-SQT  correlations  and  numeric  ID  into  XYcorr  and  MOSNumID  */ 
use  &R_Samp_MOS; 

read  all  var (TestNames)  where ( NAMES=  " SQT " )  into  XYcorr; 
read  all  var  {MOSNUMID}  where  (NAMES  ="  SQT" )  into  MOSNumID; 
close  &R_Samp_MOS ; 

/*  Read  SQT  reliabilities  into  vector  YYseal*/ 

use  Dir Path. Relib; 

read  all  var{YY}  into  YYseal; 

close  DirPath. Relib; 

NumMOS  =  nrow  (MosNumlD)  ;  /*  =nrow(CorMat)  */ 

NumTest  =ncol  (TestNames) ; 

/*  correcting  validity  coefficients  for  attenuation  using  standard  formula  */ 
correctedRxy  =  XYcorr# (1/SQRT( YYseal) ) ; 


/*  initialize  corrected  covariance  matrix  */ 
correctedCVxy  =  repeat  ( 0  *  NumMOS  #  NumTest ) ; 

/*  computing  corrected  covariances  --  one  ASVAB  subtest  column  at  a  time  */ 
use  &Descriptives_MOS; 

read  all  var{SD}  where (names =" SQT" )  into  sdY; 
do  iTest  =  1  to  NumTest; 
xName  =  TestNames  {iTest)  ; 

read  all  var{SD}  where { NAMES =xName)  into  sdX; 
correctedCVxy t  , iTest]  =  correctedRxy [ # iTest] #sdY#sdX; 
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end; 

close  &Descriptives_MOS; 

/*  creating  dataset  of  MOS  corrected  SQT-ASVAB  correlations  */ 
create  &Ryx_CorrectRelib_MOS  var  {MOSNUMID  &TESTNAMES}; 
correctedRxy  =  MosNumID  | |  correctedRxy; 
append  from  correctedRxy; 
close  &Ryx_CorrectRelib_MOS; 

/*  creating  dataset  of  MOS  corrected  SQT-ASVAB  covariances  */ 
create  &Cyx_CorrectRelib_MOS  var {MOSNUMID  &TESTNAMES}; 
correctedCVxy  =  MosNumID  | |  correctedCVxy; 
append  from  correctedCVxy; 
close  &Cyx_CorrectRelib_MOS; 

quit; 

run; 


Correction  for  Restriction  in  Range 


^******************************************************************************* 
Correcting  ASVAB-3QT  validity  coefficients  and  covariances  for 
range  restriction, 

*******************************************************************************^ 
libname  DirPath  "D: \NewAA\ * ; 

^**************************************************************** 

OUTPUT  DATASETS  -  rename  right -hand -side  as  needed 
****************************************************************^ 

/*  uncomment  line  below  if  correcting  to  Army  input  population  */ 

%let  Ryx_€orrectRelibRange_MOS=DirPath . ArmyValid; 

/*  uncomment  line  below  if  correcting  to  Youth  population  */ 

*  %let  Ryx_Corr ectRelibRange_MOS=Dir Path. You thValid_range; 


INPUT  DATASETS 

****************************************************************y? 

/*  uncomment  line  below  if  correcting  to  Army  input  population  */ 
%  1  e  t  Ref  Pops  t  a  t  s  =D  i  r  Pa  th .  SummaryS  t  a  ts_Army ; 

/*  uncomment  line  below  if  correcting  to  Youth  population  */ 

*%let  Ref Pops tats=Dir Path. PopCovYouth; 

/*  all  data  sets  below  common  to  both  reference  populations  */ 
%  let  Descript  i ve_MOS=DirPa th .  Descrip  ; 

%let  R_Samp__MOS=DirPath .  Corr ; 

%let  C_Samp_MOS=DirPath . Covar ; 

%let  Ryx_CorrectRel ib_MOS=DirPath .  CorXY ; 

%let  Cyx_CorrectRelib_MOS=DirPath , CorCV; 

/*  variable  names  for  ASVAB  subtests  */ 

%let  TESTNAMES=GS  AR  NO  CS  AS  MK  MC  El  VE; 


proc  iral; 

TestNames  =  { &TESTNAMES }  ; 

/*  read  REFERENCE  POPULATION  ASVAB  subtests  covariance  */ 
use  &Ref Pops tats ; 

read  all  var { &TESTNAMES }  where (_TYPE_= 1 COV*  &  names ?TestNames)  into  Pop Cxx; 
close  &RefPopStats; 

SDx  =  sqrt  (vecdlag(PopCxx) )  ; 

/*  open  MOS  SQT -ASVAB  covariance  corrected  for  unrel lability  */ 

use  &Cyx_Correc tRel ib_MOS ; 

read  all  var{MOSNUMID}  into  MosNumID; 

NumMOS  =  nrow | MosNumID)  ; 

/*  open  MOS  SQT -ASVAB  sample  variance-covariance  —  no  correction  */ 
use  &C_Saittp_MOS ; 

/*  create  output  data  for  range-restriction  corrected  validities  *7 
create  &Ryx_CorrectRelibRange_MOS  var {MOSNUMID  &TESTNAMES) ; 
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/* looping  through  MOSs  listed  under  MOSTextID*/ 
do  idxMOS=l  to  NumMOS; 

/*  read  reliability  corrected  ASVAB-SQT  covariance,  uncorrected  ASVAB 
variance-covariance,  and  uncorrected  SQT  variance  from  iTH  MOS  */ 

setin  &Cyx_CorrectRelib_MOS ; 

read  all  var { &TESTNAMES }  where <MOSNUMID=idxMOS)  into  Cxc;  *correctedCVxy; 
setin  &C_JSamp_MOS ; 

read  all  var { &TESTNAMES }  where  (names ?TestNames  &  MOSNUMID=idxMOS)  into  Cxx; 
read  all  var  {SQT}  where  (names=  1  SQT '  &  MOSNUMID=idxMOS)  into  Cyy; 

/*  compute  range-restriction  corrected  ASVAB-SQT  covariances  for  iTH  MOS  */ 
Pop Cxc  =  PopCxx*inv(Cxx) *Cxc' ; 

PopCcc  =  Cyy+Cxc*inv(Cxx) * (PopCxc-Cxc' ) ? 

/*  compute  range-restriction  corrected  ASVAB-SQT  correlations  for  iTH  MOS*/ 
PopRxc  -  (l/SDx/*Sxvec*/) # (PopCxc) # (1/sqrt (PopCcc) ) ; 

/*  append  iTH  MOS  SQT -AS VAT  correlations  to  output  data  */ 

TmpOutput  =  idxMOS  | |  PopRxc ' ; 
setout  &Ryx_CorrectRelibRange__MOS  ; 
append  from  TmpOutput; 

end; 

close  &Cyx_CorrectRelib_MOS; 

close  &C_Samp_MOS; 

close  &Ryx_CorrectRelibRange_MOS ; 

quit; 

run; 
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Step  2:  Aggregation  of  ASVAB  Subtests-SQT  Validities  by  Job  Family 


Aggregating  corrected  ASVAB-8QT  validity  coefficients  by  job  family, 
*****************************************************************************★*/ 

%macro  JFValid  ( JF_VALIDITY_DATA#MOS_VALIDITY_DATA#  JF_SOLUTION,  JF_CONFIG_DATA)  ; 

/*  variable  names  for  ASVAB  subtests  */ 

%let  TESTNAMES=GS  AR  NO  CS  AS  MK  HC  El  VE; 

proc  iml ; 

/*  open  data  containing  Job  Family  MOS  configuration  *7 
use  &JF_CONFIG_DATA; 

read  all  var{&JF_30LUTI0N}  into  JFSolVec; 

/*  Total  number  of  JF  in  JFSolVec  vector  */ 

NumJF  =  max (JFSolVec) ? 

/*  open  data  containing  reference  population  MOS  validities  */ 
use  &MOS_VAL IDI T¥__DATA ; 

/*  create  output  data  set  for  aggregated  JF  validities  */ 
create  & JF_VAL I D I TY_DATA  var  {  &  JF_SOLUTION  &TESTNAMES}  ; 
setout  & JF_VALIDITY_DATA ; 

do  idxJF  =  1  to  NumJF; 

/*  locate  MOS  in  iTH  job  family  and  read  acquisition  weights  */ 
set in  & JF_CONFIG_DATA ; 

MOSJFIDX  =  loc ( JFSolVec=idxJF) ; 

read  point  (MOSJFIDX)  var{AcqN>  into  NJMgt; 

/*  read  corrected  validities  of  MOSs  in  iTH  job  family  */ 
setin  &MOS_VALIDITY_DATA; 

read  point (MOSJFIDX)  var {&TE3TNAMES}  Into  XYvec; 

/*  aggregate  validity  coefficients  across  MOS  weighted  by  N  */ 

/*  -  note  job  family  index  is  concatenated  to  output  validity  vector  */ 
JFCorr  =  idxJF  \\  (diag (N_Wgt ) *XYvec) {+ t ] /sum(N_Wgt) ; 

append  from  JFCorr; 

end; 

close  & JF_CONF IG JDATA ; 
close  &M03_VALIDITY_DATA; 
close  &JF_VALIDITY_DATA; 

quit; 

run; 

%mend; 
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option  mprint=l; 

libname  DirPath  "D : \NewAA\ " ; 

/*  9  JF  validities  corrected  to  youth  population  */ 

%JFVal id (DirPath . JF9YouthVal id, DirPath . Youthvalid, JF9 , DirPath . EntryMOS155 ) ; 

/*  17  JF  validities  corrected  to  youth  population  */ 

%  JFVal id (DirPath . JF17 Youthvalid, DirPath . Youthvalid, JF 17 , DirPath . EntryMOS155 ) ; 
/*  150  JF  validities  corrected  to  Army  input  population  */ 

%  JFVal id  (Dir Path.  JF1 50 ArmyVa lid,  DirPath .  Armyval id,  JF150 ,  DirPath.  EntryMOS155)  ; 
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Step  3:  Calculation  of  Population  Beta  Weights  by  Job  Family 


^*********^********************************************************************* 
Computing  Beta  Weights  by  job  family. 

*  Use  macro  argument  CONSTRAINT  to  obtain  different  solutions: 

NONE  =  no  constraint  on  subtest  weights 
POSITIVE!  =  Postive  weights  using  Eeidner-Johnson-Vladimirsky  stopping  rule 
POSITIVE2  =  Postive  weights  —  ignoring  solutions  with  negative  weights 
*******************************************************************************/ 


/*  variable  names  for  ASVAB  subtests,  excluding  NO  and  CS  */ 
%let  TE5TNAMES  =G3  AH  AS  MK  MC  El  V£; 


%macro  BetaWeights  { BETADATA ,  COVDATA ,  VAL  ID  I TYDATA ,  JFSOLUTION,  CONSTRAINT)  ; 

%let  CORRDATA=TMPCORRDATA ; 
proc  iml ; 

TestNames  =  {^TESTNAMES  SQT) ; 

NTests  =  ncol (TestNames) ; 

_TYPE_={"MEAN%  "STD",  "N"}//j  {NTests, 1,  •’CORK")  ; 

_NAME_=j (3,1, "")//t (TestNames) ; 

call  symput  (  * MNTESTS '  ,  char  (NTests) )  ? 

/*  Used  later  for  CONSTRAINT=POSITIVE  */ 
call  symput ( 1 MNTESTS_ASVAB  * , char (NTests-1 ) ) ; 

do  i=l  to  NTests,* 
if(i<10)  then 

MTESTNAME  =  concat ( ' MTESTNAME  * , char (1,1,0)); 
else 

MTESTNAME  =  concat  {  'MTESTNAME* ,  char  (i,  2 , 0)  )  ; 
call  symput  (MTESTNAME ,  TestNames  [ i] )  ; 
end; 

use  & COVDATA ; 

read  all  var { ^TESTNAMES }  where  ( (Names? TestNames)  &  ( Names  A  ?  "SQT" ) )  into  RXX; 
close  &COVDATA; 

SXX_INV  =  sqrt (diag (1/RXX) ) ; 

RXX  =  3XX_INV*RXX*5XX_INV; 

XMEAN  =  j  (1, NTests,  0)  ; 

XSTD  =  j (1, NTests, 1) ; 

/*  NOT  actual  sample  sizes,  but  does  not  matter  for  estimation  */ 

XN  =  j (1, NTests, 10000) ; 

/*  Read  Validity  Data  Matrix  --  Note  that  MOS/JF<->Row  */ 
use  &VALIDITYDATA; 

read  all  var {&TESTNAMES}  Into  RXY__ALL; 
read  all  var JFSOLUTION}  Into  JFNO_ALL; 
close  &VALIDITYDATA; 

/*  For  each  job  family,  read  validities  and  create  correlation  matrix  */ 
create  &CORRDATA ( Type=corr )  var  ({  &  JFSOLUTION  _TYPE_  _NAME_}  j  (TestNames)  ; 
do  iJF  =  1  to  nrow(JFNO_ALL)  ; 

IdxJF  =  JFNO_ALL[iJF]  ; 


A-8 


&JFSOLUTION  =  j (nrow(_TYPE_) , 1, IdxJF) ; 

RXY  =  RXY_ALL[iJF, ] ; 

XCORR  =  (RXX//RXY) | | (t (RXY) //l)  ; 

XDATA  =  XMEAN//XSTD//XN/ /XCORR; 

%do  i=l  %tO  &&MNTESTS; 

&&MTESTNAME&i  =  XDATA [, &i ] ; 

%end; 

append 

end;  /*  ENDOF:  do  iJF  =  1  to  nrow ( JFNO_ALL)  */ 

Close  &CORRDATA; 

quit; 

run; 

%if  &CONSTRAINT=NONE  %then 
%let  MODELOPTION=NOINT; 

%else 

%let  MODELOPTION=NOINT  SELECTION=RSQUARE  B; 
proc  reg  data=&CORRDATA 

OUtest=&BETADATA  (keep=& JFSOLUTION  &TESTNAMES  _RSQ _ P_) 

NOPRINT; 

model  SQT  =  &TESTNAMES  /  &MODELOPTION; 
by  & JFSOLUTION ; 
quit; 
run; 

/★★★★★★it*********************************************************** 

Zeidner-Johnson-Vladimirsky  Non-negative  Beta  Weights  Approach 
******************************************************************/ 

%if  &CONSTRAINT=POSITIVEl  %then  %do; 
proc  sort  data=&BETADATA; 

by  & JFSOLUTION  descending  _P_  descending  _RSQ_; 
run; 

/*  Oragnize  all  possible  solutions  using  two  data  sets:  */ 

/*  TmpBetaPositive:  solutions  with  non-negative  weights  */ 

/*  TmpBetaMax:  solutions  with  maximum  R  for  each  JF  &  no.  subtests  pair  *f 
data  TmpBetaPositive 
TmpBetaMax 

(keep=& JFSOLUTION  _RSQ _ P_) ; 

array  Beta  { &MNTESTS_ASVAB }  &TESTNAMES ; 
set  &BETADATA; 

by  &JF SOLUTION  descending  _P__  descending  _RSQ_; 

NegativeWgtFlag  =  0; 
do  i=l  to  &MNTESTS_ASVAB; 

if  (Beta{i}=.)  then  Beta{i}  =  0; 

NegativeWgtFlag  =  NegativeWgtFlag  or  (Beta{i}<0); 
end; 

/*  output  all  solutions  without  negative  weights  */ 
if  ('"NegativeWgtFlag)  then 
output  TmpBetaPositive; 

/*  output  subset  with  maximum  R  overall  for  given  number  of  subtests  */ 
if  (First. _P_  and  '"First . &JFSOLUTION)  then  do; 

=  _P_+1; 

output  TmpBetaMax; 
end; 

run; 
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/*  output  positive  weighted  solutions  with  K2  >=  max  R2  in  the  next  level  */ 
data  TmpCompare; 

keep  &JFSOLUTION  &TESTNAMES  _RSQ_; 

merge  ItapBetaFositive  TmpBetaMax  { rename  =  (_RSQ_=Rmax) )  ; 
by  SrJFSOLtTTION  descending  _P_; 
if{_RSQ_  >=  Umax)  then  output; 
run; 

/*  output  only  weights  with  maximum  number  of  subsets  for  job  family  */ 
data  &BETADATA; 
set  TmpCompare; 

by  &JF30LUTION  descending  _RSQ_; 
if  First . ScJFSOLUTION  then  output; 
run; 

%end; 

^****************************************************************** 

HumRRO  Simple  Non-negative  Beta  Weights  Approach; 

-  Entirely  ignore  solutions  with  negative  weights, 
******************************************************************/ 

%if  &C0NSTRAINT=P0SITIVE2  %then  %do; 

/*  keep  only  solutions  with  all  positive  weights  */ 
data  TmpBetaPositive; 

array  Beta  { &MNTESTS_ASVAB }  &TESTNAMES; 

set  METADATA; 

do  i=l  to  &MNTESTS_ASVAB  ; 

if  (Beta{i}=.)  then  Beta{i}  =  0; 
else  if  (Beta{i}<0)  then  deleter- 
end; 
run; 

proc  sort  data=TmpBetaPositive; 

by  &JFSOLUTION  descending  _RSQ_; 
run; 

/*  output  all  positive  weights  solution  with  maximum  R2  *7 
data  &BETADATA; 

keep  Sc  J F S GLUT  I  ON  &TESTNAMES  _RSQ_; 
set  TmpBetaPositive; 
by  &JFSOLUTION  descending  RSO  ; 
if  First . &JFSOLUTION  then  output ; 
run; 

%end; 

%mend; 


option  mprint=l ; 

libname  DirPath  11 D;  \NewAA\  "  ; 

%BetaWeights  (Modlib.  JF9Beta,Modlib.  PopCovYouth,  Modlib.  JfSyouthvalidr  JF9 ,  POSITIVEl)  ; 
%BetaWeights  (Modlib .  JF1 7 Beta  #  Modlib ,  PopCovYouth*  Modlib .  Jf  17youthvalid  #  JF17  #  POSITIVEl )  ; 
%BetaWeights(Modlib.  JF150Beta,Modlib.PopCovArmyrHodlib.  Jfl50ArmyValid#  JF150#NONE) ; 
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Step  4-5:  Calculation  of  Operational  ASVAB  Subtest  Weights  and  Constant 


Computing  Beta  Weights  by  job  family. 


/*  variable  names  for  ASVAB  subtests,  excluding  NO  and  CS  */ 
%let  TESTNAMES=GS  AR  AS  MK  MC  El  VE; 


%macro  UKWeights  (UKDATA,  COVDATA,  POPDATA,  BETADATA,  JFNUM,  TYPE)  ; 
proc  iml ; 

Subtest  =  {&TESTNAMES} ; 

/*  predictor  correlation  matrix  for  Army  Input  Population*/ 
use  &COVDATA; 

read  all  var { &TESTNAMES }  where (names ? Subtest )  into  CovMat; 
close  &COVDATA; 

use  &POPDATA; 

read  all  var{SD}  where {test ?Subtest)  into  SDvec; 

%if  &TYPE=TIER1  %then  %do; 

read  all  var {MEAN}  where (test ?Subtest)  into  Means; 

%end; 

close  &POPDATA; 

SDProd  =  1/ ( SDvec# SDvec ) ; 

R  =  CovMat# SDProd' ; 

/* reading  in  all  JFs  into  JFNO_ALL*/ 
use  &BETADATA; 

read  all  var {& JFNUM}  into  JFNO_ALL; 

NumJF  =  nrow ( JFNO_ALL ) ; 

/*creating  SAS  dataset  containing  u  weights  and  k  values  for  all  JFs  */ 
create  &UKDATA  var{JFNO  &TESTNAMES  k} ; 

do  idxJF=l  to  NumJF; 

^converting  beta  weights  to  b-weights  for  MOS-level*/ 
set in  &BETADATA; 

read  all  var { &TESTNAMES }  where (&JFNUM=idxJF)  into  ObsBeta; 
bweights  =  ObsBeta# ( 1 /SDvec ') ; 

/* transform  b-weights  to  u  and  k  values  for  Tier2  */ 

%if  &TYPE=TIER2  %then  %do; 

/*  composite  multiplier*/ 

CM  =  20/ (10* (SQRT (bweights *R*bweight s' ) ) ) ; 

/*  calculate  U  and  K  values  */ 

Uvec  =  diag (CM) *bweights ; 

K  =  (SUM(Uvec) *50) -100; 

%end; 

/* transform  b-weights  to  u  and  k  values  for  Tierl  */ 

%else  %if  &TYPE=TIER1  %then  %do; 

/*  calculate  U  and  K  values  */ 

Uvec  =  bweights; 
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/*  sum  ASVAB  means  weighted  by  their  respective  b-weight*/ 

K  =  SUM(Uvec#Means'  )  ; 

%end; 

/♦merging  u  values  with  k  value  and  adding  a  column  for  JFNO* / 

UKvec  =  J{nrow(K)  ,1,  idxJF)  ||  Uvec  ||  K; 

append  from  UKvec; 

end; 

close  SOTCDATA; 
close  &BETADATA; 

quit; 

run; 

%mend; 

option  mprint=l; 

libname  Dir Path  "D: \NewAA\ " ; 

/*  9  JF  operational  weights  corrected  to  youth  population  */ 

%UKWeights  (DirPath ,JFby9ukf  DirPath .  PopCovYouth,  DirPath.  PopDescripYouth, 
DirPath .  JFSBeta ,  JF9 ,  TIER2 ) 

/*  17  JF  operational  weights  corrected  to  youth  population  */ 

%UKWeights  {DirPath .  JFbyl7uk#  DirPath .  PopCovYouth,  DirPath .  PopDescripYouth, 
DirPath . JF17Beta , JF17 , TIER2 } 

/*  9  JF  operational  weights  corrected  to  Army  input  population  */ 

%  UKWeights  (DirPath .  JFbylSOuk  #  DirPath ,  PopCovArmy f  DirPath ,  PopDescr  ipArmy , 
DirPath. JFISOBeta , JF150 , TIER1 ) 
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APPENDIX  B:  ORIGINAL  PROGRAMS  IMPLEMENTING  ZEIDNER,  JOHNSON, 

AND  COLLEAGUES  (2000)  METHOD 
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Part  A:  Step  1 


f******** ******************************************************************************** 

Compute  basic  descript ives  for  155  MOS  and  Army  Input  population; 

Correct  ASVAB-SQT  validities  for  criterion  unreliability  and  range  restriction. 
****************************************************************************************/ 


new; 

NAME  =  {  /*  List  of  155  MOS  names  */ 

" 11B"  , 

"llCtt  , 

* . ,  . (con. 

" 98G"  , 

"98H"  # 

”9BZn 

}  ; 

/*  Load  vector  of  SQT  reliabilities  */ 

LOAD  rlblt[]  =  A\data\reliabty; 

/*  Determine  number  of  MOS  in  vector  of  SQT  reliabilities  */ 

JOBS  =  ROWS {  RLBLT  ); 

/*  Set  ASVAB  subtest  names  for  output  */ 

test  =  {  "GS  "  "AR  *  “NO  *  *CS  8  "AS  "  "MK 

nMC  "  "El  "  "VE  "  "SQT  "  }; 

/*  Initialize  a  corrected  population  matrix  *7 
Rt  =  zeros C  10,  10  }; 

/*  Index  vector  for  the  explicit  variables  -  9  ASVAB  subtests  */ 
indx  ={123456789}; 

/*  Index  for  the  implicit  variables  -  SQT  */ 
indy  =  {  10  }  ; 


/*  Combined  vector  for  explicit  and  implicit  variables  */ 
indt  =  indx  -  indy; 

/*  Remove  existing  Army  data  file  in  order  to  avoid  appending  the  same  data  *7 
DOS  DEL  ARMY  \ ARMY ,  DAT ; 

j***************************************  *********  ************************************** 

Create  Army  Input  population  data  file  and  compute  basic  descript  ives  and  ASVAB 
intercorrelation  matrix 

**************************************************************************************/ 


x  =  l; 

DO  WHILE  I  <=  JOBS;  /*  Beginning  of  loop  */ 

/*  Create  DOS  command  to  append  MOS  file  */ 

CMD  =  "TYPE  JOBS \ \ "  $+  NAME  [  I  ]  $+  "  »  ARMYWARMY.DAT"; 

DOS  ACMD;  /*  Execute  the  above  command  */ 

1=1+1; 

ENBO;  /*  End  of  loop.  File  ARMY.DAT  contains  data  from  all  MOS  */ 
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fl 


ARMYWARMY.DAT”  ; 


load  X[  ]  =  -fl; 
nrws  =  rows (  X  )  /  1 0 ; 

X  =  reshape (  X,  nrws,  10 
SD_a  =  stdc(  X  ) ; 

MEAN_a  =  meanc  (  X  )  ; 


/*  Load  the  Army  Input  population  data  file  */ 
/*  Compute  N  for  Army  Input  population  */ 

/*  Reshape  the  matrix  */ 

/*  Compute  SDs  for  Army  Input  population  */ 

/*  Compute  means  for  Army  Input  population  */ 


format /rd  21,16; 


/*  Output  SDs  */ 

output  file  =  "armyWSD"  reset; 
print  SD_a ; 


/*  Output  means  */ 

output  file  =  "ARMYWMEAN"  reset; 
print  MEAN_a; 
output  off; 

/*  Compute  variance-covariance  matrix  for  9  ASVAB  subtests  */ 

VCxx  =  vex (  X [  . ,  indx  ]  ) ; 

/*  Output  ASVAB  variance-covariance  matrix  *( 
screen  off; 
format/rd  20,16; 

OUTPUT  FILE  =  ARMY\ VAR_C0V . ASC  RESET; 

PRINT  VCxx; 

/*  Compute  ASVAB  intercorrelation  matrix  from  variance-covariance  matrix  */ 
Gxx  =  corrvc (  VCxx  ) ; 

/*  Output  intercorrelation  matrix  */ 
output  file  =  " ARMY \ \ CORR_ARM . ASC "  reset; 
print  Gxx; 


CLEAR  X;  /*  Remove  matrix  of  Army  Input  data  from  memory  to  free  space  */ 


NUMS=ZEROS(  JOBS , 1 ) ;  /*  Initialize  vector  of  observed  MOS  sample  sizes  (N)  */ 


/*************************************************************************************/ 
/***  process  all  155  MOS.  Compute  corrected  ASVAB-SQT  validities  for  all  MOS  *********/ 
/*******************************************************★*****************★***********/ 

N  =  0; 

1  =  1; 

do  while  1  <=  jobs; 

format/rd  20,16; 

fl  =  "JOBSW"  $+  name  [  1  ]; 
load  X[  ]  =  Afl;  /* 

nrws  =  rows (  X  )  /  10;  /* 

NUMS  [  L  ]  =  NRWS;  /* 

X  =  reshape (  X,  nrws,  10  );  /* 

MEAN  =  MEANC (  X  ) ;  / * 

SD  =  stdc (  X  ) ;  /* 

/*  Compute  ASVAB-SQT  variance-covariance  matrix  (VCV)  for  current  MOS  */ 

VC_1  =  vex (  X  ) ; 

/*  Compute  correlation  matrix  from  VCV  matrix  for  MOS  */ 

RV_1  =  corrvc (  VC_1  ) ; 

/*  Extract  9x9  submatrix  corresponding  to  ASVAB  subtests  from  VCV  matrix  */ 


Load  matrix  of  ASVAB-SQT  data  for  current  MOS  */ 
Find  number  of  rows  in  the  data  matrix  */ 

Update  vector  of  MOS  sample  sizes  */ 

Reshape  the  data  matrix  */ 

Compute  means  for  current  MOS  */ 

Compute  SDs  for  current  MOS  */ 
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Gxx_  1  =  VC_1  [  indx,  indx  ]  ; 

/*  Extract  9x1  submatrix  corresponding  to  A3VAB-SQT  validities  from  VCV  matrix  */ 
Gxy  =  VC_1[  indx,  indy  ]; 

/*  Correct  ASVAB -3QT  validities  for  criterion  unreliability  */ 

Gxy  =  Gxy  /  sqrt{  rlblt[  1  J  ); 

/*  Correction  for  restriction  in  range  to  Army  Input  Population  */ 

Gyy  =  VC_1[  indy,  indy  ];  /*  Extract  variance  for  SQT  */ 

/*  Put  together  VCV  matrix  and  compute  correlation  matrix  */ 

RV  =  corrvc {  ( f  VCxx -Gxy  )  |  (  Gxy  * -Gyy  ) )  )  ; 

/*  Use  correction  method  described  in  literature  */ 

Gxy_a  =  VCxx  *  inv (  Gxx_l  )  *  Gxy; 

Gyy_a  =  Gyy  +  Gxy 1  *  inv {  Gxx_l  )  *  {  Gxy_a  -  Gxy  ) ; 

G_a  =  C  VCxx  -  Gxy_a  }  |  {  Gxy_a '  -  Gyy_a  );  /*  G__a  is  corrected  VCV  matrix  */ 
/*  Compute  correlation  matrix  from  range  restricted  corrected  VCV  matrix  */ 

RV_a  =  corrvc{G_a); 

/* Output  ASVAB -SQT  validities  corrected  to  Army  Input  population  */ 
screen  off; 

FORMAT/RD  20,16; 

fl  =  tfARMY\\ "  $+  name[  1  ]  $+  11 .  VLD" ; 
output  file  =  Afl  reset; 
print  RV_a [  indy,  indx  ]; 

OUTPUT  OFF; 


/*  Correction  for  restriction  in  range  to  1980  Youth  population  */ 

/*  Load  ASVAB  in  ter  correlation  matrix  for  1980  Youth  from  the  literature  */ 
load  VC^[  9,  9  ]  =  \YEFIM\ARI\corr.dat; 

/*  Multiply  correlations  by  variance  of  the  Youth  population,  which  Is  equal  100  */ 
VC_y  =  VC_ y  *  100.; 

/*  Use  correction  method  from  literature  */ 

Gxy_y  =  VC_y  *  inv{  Gxx_l  )  *  Gxy; 

Gyy_y  =  Gyy_a  +  Gxy_a *  *  inv  {  VCxx  )  *  {  Gxy__y  -  Gxy_a  )  ; 

G_y  =  {  VC_y  -  Gxy_y  )  |  {  Gx y_y*  -  Gyy_y  );  /*  G_y  is  corrected  VCV  matrix  */ 

/*  Compute  correlation  matrix  from  range  restricted  corrected  VCV  matrix  */ 

RV_y  =  corrvc {  G_y  ) ; 

/*  Output  ASVAB -SQT  validities  corrected  to  1980  Youth  Population  */ 
screen  off; 

FORMAT/RD  20,16; 

fl  =  ” YOUTHS \ "  $+  namef  1  ]  $+  ".VLB"; 
output  file  =  Afl  reset; 
print  RV_y[  indy,  indx  ] ; 

OUTPUT  OFF; 

/*  Output  of  ASVAB -SQT  validities  for  validation  check  */ 
fl  =  "JOBSW"  $+  name!  1  ]  $+  ".CHK"; 

SCREEN  OFF; 

output  file  =  Afl  reset; 

FORMAT  3,0; 
print ; 

PRINT  $name  [  1  ]  ; 

print  "  Uncrr  At  ten  Army  Youth  STD  MEAN"; 

print; 

FORMAT/RD  7,4; 

K  =  1; 

DO  WHILE  K  <=  10; 

print  RV_1 [K, 10] ~RV[K, 10]~RV_a[K, 10]-RV_y[K, 10]~SD[K]~MEiUSF[K]  $TEST[K] ; 

K  =  K  +  1; 

ENDO; 
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/*  Check  for  non-positivity,  i.e.,  correlation  matrices  must  be  non-singular.  */ 
d  =  det {  RV_a  ) ; 
if  d  >  0; 


else ; 

screen  on; 

print  $name [  1  } ; 

print  "Determinant  "  d; 

screen  off; 

end if ; 

1  =  1  +  1; 

endo ; 

;************************  End  of  processing  of  all  MO S  ******************************/ 

output  off-¬ 
screen  on; 
end; 
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Part  B:  Steps  2-5 


NEW; 

REPS  =  0; 


S&MPL  =  1000; 


/*  Set  flag  for  negativity  or  positivity  of  composite  weights  */ 
NEGATIVE  =  0  ;  @  1  -  with  negatives,  0  -  without  negatives  @ 


/*  Initialize  sets  of  indices  for  different  A3VAB  batteries  */ 


ALLtests  =  {  1,2,3,4,5,6,7,8,91; 
NO_out  =  {  1,  2,  4,  5,  6,  7,  8,  9  }; 
CS_out  =  {  1,  2,  3,  5,  6,  7,  8,  9  >; 
NOCS_out  =  {  1,  2,  5,  6,  7,  8,  9  }; 


8  All  tests  § 

§  Without  NO  test  @ 

§  Without  CS  test  8 
8  Without  NO  and  CS  tests  8 


TESTS  =  nocs_out;  /*  This  one  excludes  NO  and  CS  */ 


N_tests  =  ROWS  {  TESTS  };  /*  Determine  number  of  ASVAB  subtests  */ 


/*  Define  full  names  for  all  155  MOS  */ 
MOS  =  { 


11B" 

"Infantry" 

"man  " 

n  n 

" 

n 

11C" 

" Indirect  * 

"  Fire  In" 

" f antryma " 

"n 

n 

. , . {con, )  , . .  * 

98G" 

"EW  Signa" 

"1  In tell" 

"igence  V" 

"oice 

Int" 

98H" 

"Morse  In" 

" tercepto " 

» j-  H 

it 

it 

982" 

}  ; 

"Emitter  ■ 

"Locator/" 

"Identifi" 

"  er 

w 

"errogato" 

n  w 

u  n 


it 


"r 


« 


n 


it 


indx  ={123456789}; 
indy  =  {  10  } ? 


/*  Index  for  the  explicit  variables  */ 
/*  Index  for  the  implicit  variables  */ 


indt  =  indx  ~  indy; 


/*  Load  precomputed  cluster  solution  */ 

LOAD  CLUST [ 1  =  CLUST. OUT; 

/*  Determine  number  of  MOS  */ 

JOBS  =  ROWS {  CLUST  ) ; 

/*  Load  acquisition  numbers  based  on  Seabrook  Report  {1989}  */ 

LOAD  NUM[]  =  \YEFIM\ARI\1996\a\DATA\acquisit; 

/*  Determine  number  of  job  families  by  the  largest  cluster  number  */ 
FMLS  =  MAXC  {  CLUST  ); 

/*  Create  character  names  for  clusters,  i.e.,  1,  2,  ...  * / 

NAME  =  SEQA {  1 ,  1 ,  FMLS  } ; 

NAME  =  0  $+  FTOCV {  NAME  ,  3,0  }; 

/*  Start  of  Step  2*/ 

FORMAT/RD  20,  16; 

/*  Set  output  file  for  aggregated  ASVAB-SQT  validities  */ 

OUTPUT  FILE  =  FMLSXSQT  RESET; 

/*  Initialize  quota  for  job  families  */ 
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QUOTA  =  ZEROS (  FMLS ,  1  ); 


/*  Aggregate  ASVAB-SQT  validities  to  JF-level  using  cluster  solution  */ 
L  =  1; 

DO  WHILE  L  <=  FMLS; 

V_f  =  zeros (  9,1  ) ; 

N  =  0; 

K  =  1; 

DO  WHILE  K  <=  JOBS; 

IF  CLUST [  K  ]  ==  L; 

/*  If  Youth  is  used  to  create  visible  system  */ 
fl  =  " YOUTH \ \ 11  $+  mos[  K,  1  ]  $+  "  .VLD"  ; 

/*  If  Army  is  used  to  create  invisible  system  */ 

/*  fl  =  “  ARMY\  \ 11  $+  most  K,  1  ]  $+  ".VLD"  ; 

*/ 

load  RV_p[  ]  =  Af  1 ; 

V_f  =  V_f  +  RV_p  *  NUM  t  K  ]  ; 

N  =  N  +  NUM [  K  ] ; 

END IF ; 

K  =  K  +  1; 
endo ; 

/*  Output  aggregated  ASVAB-SQT  validities  */ 

SCREEN  OFF; 
if  N  >  0; 

print  V_f /N; 
else; 

print  V_f/5000; 
endi f ; 

QUOTA [  L  ]  =  N;  /*  Update  job  family  quota  */ 

L  =  L  +  1; 


ENDO; 


/**★*★**★**★  Encj  Qf  aggregating  MOS  into  families 


/*  End  of  Step  2  */ 


output  off; 


Computation  of  Composites 

/*  Start  of  Step  3  */ 

test  =  {  "  GS  "  "  AR  *  "  NO  ”  "  CS  "  "  AS 

"  MK  "  "  MC  "  "  El  "  "  VE  "  }  ; 

test  =  test [  TESTS]; 

nmb  =  {  "  1  "  -  2  "  "  3  " 

..  6  "  »  7  «  •'  8 
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y  =  date; 
format/ldn  1,0; 

output  file  =  M  OUT  *  CRT *  reset; 

SCREE®  ON; 

PRINT  " 

y[3]  */*  y[2]  «/K  y C 1 ]  ; 


print 


TEST  COMPOS IT  FOR  SQT  „  (  SAMPLE  A+B+C  ) . " ; 


format/rdn  8,3; 

PRINT ; 

print  *  *  $test; 

tested  ={23456789}; 


load  V[  ]  =  "EMLSWSQT"; 

FMLS  =  ROWS (  V  }  /  9; 

V  =  reshape!  V,  FMLS,  9  ); 

/*  This  file  is  used  for  invisible  tier  */ 

/*load  RV__FULL[  9,  9  ]  =  11  ARMY\ \CORR_ARM , ASC *  ;  *  / 

/*  This  file  is  used  for  visible  tier  */ 

load  RV_FULL [  9,  9  ]  =  W\\YEFIM\\ARI\\ CORR. DAT” ; 

/*  Extract  ASVAB  inter  correlation  matrix  from  full  9x9  matrix  */ 

RV  =  RV_full [  TESTS,  TESTS] ; 

/*  Initialize  matrix  of  weights  (us)  */ 

W  =  zeros!  N_tests,  FMLS  ); 

/*  Initialize  matrix  of  Us  */ 

U  =  W; 

/*  Initialize  matrix  of  Ks  */ 

KU  =  ZEROS!  1,  FMLS  ); 

load  MEAN!  9,  1  ]  =  "ARMYWMEAN" ;  /*  Load  vector  of  means  for  all  9  ASVAB  subtests  */ 

MEAN  =  MEAN!  TESTS,  /*  Extract  means  for  specified  ASVAB  battery  */ 

load  SD[  9,  1  ]  =  **ARMY\  \SD“ ;  /*  Same  as  for  the  means  */ 

SB  =  SD[  TESTS,  /*  Same  as  for  the  means  */ 

/*  Compute  diagonal  matrix  of  reciprocal  to  SDs  */ 

SD  =  DIAGRV !  zeros!  N_tests,  N_tests  ),  1/SD  }; 

S  =  DIAGRV!  ZEROS!  FMLS,  FMLS  ),  1/SQRT!  DIAG!V[ . ,  tests]  *INV{RV)  *V[ .  ,  tests]  *}}}  ; 

/*  Estimate  composite  weights  for  all  families  */ 

1  =  1; 

do  while  1  <=  FMLS;  /*  Start  of  loop  */ 

V_1  =  V[  L,  tests  3  ;  /*  Extract  SQT  validities  for  given  set  of  ASVAB  subtests  */ 

W_CT  =  inv{  RV  }  *  V_1 ' ;  /*  Estimate  Beta  weights  for  given  set  of  ASVAB  subtests  */ 

FV_CTP  =  sqrt!  V_L  *  W_CT)  ; 

MV  =  PV_CTP ;  /*  Compute  multiple  R  */ 

/*  Find  composite  without  negative  weights  */ 
if  negative  ==  0; 
ko  =  1; 

do  while  ko  <=  N_tests; 
if  W__CT [  ko  ]  <0; 

RV_0  =  zeros {  9 ,  9  ) ; 

RV_0[  TESTS,  TESTS  J  =  RV; 

{  W_CT,  MV  }  =  select_8 !  RV_0,  V[  L,  .  ]  3  ; 
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/ 


W_CT  =  W_CT [  TESTS  ] ; 
break ; 
endif ; 

ko  =  ko  +  1; 
endo ; 
endif; 

W[  .,  1  }  =  W_CT;  /*  Update  matrix  of  weights  * 

/*  Determine  order  of  weights  in  composite  */ 
format /rd  6,3; 

PV_CT  =  ones (  1,  N_tests  )  *10; 
k  =  1; 

do  while  k  <=  N_tests; 
order  =  1; 
kk  =  1; 

do  while  kk  <=  N_tests; 

if  W[  k,  1  ]  <  W[  kk,  1  ] ; 

order  =  order  +  1; 
endif ; 

kk  =  kk  +  1; 
endo ; 

PV_CT[  k  3  =  order; 

IF  W[  K,  L  ]  ==  0.  ; 

PV_CT[  K  ]  =  10; 

ENDIF; 
k  =  k  +  1; 
endo ; 

/*  End  of  Step  3  */ 

/*  start  of  Steps  4  &  5  */ 

f*  Transform  Beta  weights  to  Us  and  Ks  for  computing  AA  composites  scores,  with  mean  0 
and  SD  1,  for  invisible  tier  */ 

U  [  .  ,  L  ]  =  SD  *  W  [  .  ,  L  ]  ; 

KU [  L  ]  =  MEAN '  *  U [  . ,  L  ] ; 

output  file  =  "OUT. CRT"  on; 

SCREEN  ON; 

FORMAT /RDN  5,0; 
print  1  ; 

FORMAT /RDN  8,5; 

PRINT  "  "  MV; 

PRINT  "  "  $NMB [  PV_CT  3 ; 

print  "  "  W[  .  ,  1  ]  '  ; 

1  =  1  +  1; 

OUTPUT  OFF ; 
endo ; 

/*  Transform  Beta  weights  to  Us  and  Ks  for  computing  AA  standard  scores,  with  mean  100 
and  SD  20,  for  visible  tier  */ 

U  =  W  *  S  *  2 .  ; 

KU  =  50  *  ONES (  1,  N_tests  )  *  U  -  100.; 

OUTPUT  FILE  =  " U . OUT "  RESET; 

PRINT  U • ; 

OUTPUT  OFF; 

OUTPUT  FILE  =  " K . OUT "  RESET; 
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print  KU  *  ; 

OUTPUT  OFF; 

closeall ; 
screen  off; 

/*  Step  3  (eon.)  */ 

/*  Below  are  the  procedures  used  to  eliminate  negative  weights  from  visible  tier 
composites  */ 


proc  {  2  )  =  select_6 (  RV,  V  ) ; 

local  W__CTP ,  W_CT,  PV_CTP,  PV__CT,  id,  flag,  n,m,  i,  j  ,k,b,  c,num,  e,test_id; 

test_id  ={234567}; 
num  =  1 ; 

PV_CTF  =  zeros {  130,  9  ); 

P¥_CT  =  zeros (1,9); 

W_CTP  =  zeros (9,1); 
id  =  zeros (  1 ,  6  ) ; 

c  =  1; 

do  while  c  <=  4; 
n  =  c  +  1; 
do  while  n  <=  5; 
m  =  n  +  1; 
do  while  m  <=  6; 
i  =  m  +  1; 
do  while  i  <=  7; 

j  =  i  +  1; 
do  while  j  <=  8; 
k  =  j  +  1; 
do  while  k  <=  9; 


id[  1  ]  =  c; 
id[  2  3  =  n; 
id[  3  ]  =  m; 
id [  4  ]  =  i; 
id[  5  ]  =  j; 
id[  6  ]  =  k; 

if  det(  RV[  id,  id  1  3  ==  0; 
k  =  k  +  1; 
continue; 
endif ; 

W__CT  =  inv(  RV[  id,  id  ]  )  *  V[  1,  id  ]  '  ; 

PV_CTP[  num,  1  3  =  sqrt(  V[  1,  id  ]  *  W_CT}  ; 

PV_CTP [  num,  test_id  ]  =  id; 

if  num  ==  1; 

num  =  num  +  1 ; 
continue; 
endi f ; 

if  PV_CT [  1  ]  <  PV_CTP[  num,  1  ]; 
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flag  =  1; 
e  =  1; 

do  while  e  <=  6; 

if  W_CT[  e  ]  <0; 
flag  =  -1; 
break; 
end if ; 
e  =  e  +  1  ; 
endo ; 

if  flag  ==  1 ; 

PV_CT  =  PV_CTP[  num,  .  J; 

W_CTP  =  zeros (  9 ,  1  ); 

W_CTP[  PV_CT[  test_id  ]  ]  =  W_CT; 

end if ; 

end if ; 

num  =  num  +  1  ; 

k  =  k  +  1; 
endo ; 

j  =  j  +  l; 

endo ; 

i  =  i  +  1; 
endo ; 

m  =  m  +  1; 
endo ; 

n  =  n  +  1; 
endo ; 

c  =  c  +  1; 
endo ; 

if  W_CTP*W_CTP'  ==  0; 

{  W_CTP,  PV_CT [  1  ]  }  =  select_5 (  RV,  V  ); 
end if ; 

retp (  W_CTP,  PV_CT [  1  ]  ); 

endp ; 


proc  (  2  )  =  select_5 (  RV,  V  ) ; 

local  W_CTP,  W_CT,  PV_CTP ,  PV_CT ,  id,  flag,  n,m,  i , j , k, b, c , num,  e,test_id 

testj.d  ={  2  3  4  5  6  }; 
num  =  1 ; 

PV_CTP  =  zeros (  130,  9  ); 

PV_CT  =  zeros (1,9); 

W_CTP  =  zeros {  9 ,  1  ) ; 
id  =  zeros (  1 ,  5  ) ; 

n  =  1; 

do  while  n  <=  5; 
m  =  n  +  1; 
do  while  m  <=  6 ; 
i  =  m  +  1; 
do  while  i  <=  7 ; 
j  =  i  +  1; 
do  while  j  <=  8; 
k  =  j  +  1; 
do  while  k  <=  9; 
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id  [  1  ]  =  n; 

id[  2  1  =  m; 

id[  3  ]  =  i; 

id[  4  ]  =  j; 

id[  5  ]  =  k; 

if  det{  RV[  id,  id  ]  )  ==  0; 
k  =  k  +  1; 
continue; 
endif ; 

W_CT  =  inv{  RV[  id,  id  3  )  *  V[  1,  id  ]  '  ; 

PV_CTF[  num,  1  ]  =  sqrt {  V[  1,  id  3  *  W_CT} 

PV_CTP  [  num,  test_id  3  =  id; 

if  num  —  1; 

num  =  num  +  1; 
continue; 
endif; 

if  PV_CT[  1  3  <  PV_CTP[  num,  1  ]y 

flag  =  1; 
e  =  1; 

do  while  e  <=  5; 

if  W_CT[  e  3  <0; 
flag  =  -1 ; 
break; 
endif; 
e  =  e  +  1; 
endo ; 

if  flag  ==  1; 

PV_CT  =  PV_CTF [  num,  .  3  ? 

W_CTF  =  zeros (  9 ,  1  } ; 

W_CTP [  PV_CT [  test_id  3  3  =  W_CT; 
endif ; 


endif; 

num  =  num  +  1; 

k  =  k  +  1; 
endo ; 

endo ; 

i  =  i  +  1; 
endo ; 

m  =  m  +  1; 
endo ; 

n  =  n  +  1? 
endo ; 

if  W_€TP*W_CTP*  ==  0; 

{  W_€TP,  PV_CT[  1  ]  }  =  select_4(  RV,  V  ); 
endif; 

retp{  W_CTP,  PV_CT{  13); 
endp; 
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proc  (  2  )  =  select_4 (  RV,  V  ); 

local  W_CTP,  W_CT,  PV„CTP,  PV„CT,  id,  flag,  n,m,  i,  j  , k,b,  c,num,  e,test_id 

test_id  ={2345}; 
num  =  1 ; 

PV_CTP  =  zeros  (  130,  9  ); 

PV_CT  =  zeros (  1,  9  )  ; 

W_CTP  =  zeros {  9,  1  ); 
id  =  zeros (1,4); 

m  =  1  ; 

do  while  m  <=  6; 
i  =  m  +  1; 
do  while  i  <=  7; 
j  =  i  +  1; 
do  while  j  <=  8; 
k  =  j  +  1; 
do  while  k  <=  9; 

id[  1  ]  =  m; 

id[  2  ]  =  i; 

id  [  3  ]  =  j ; 

id [  4  ]  =  k; 

if  det (  RV [  id,  id  ]  )  ==  0; 
k  =  k  +  1; 
continue; 
end if ; 

W_CT  =  inv(  RV[  id,  id  ]  )  *  V[  1,  id  ]  1  ; 

PV_CTP[  num,  1  ]  =  sqrt(  V[  1,  id  ]  *  W_CT)  ; 

PV_CTP[  num,  test_id  ]  =  id; 

if  num  ==  1; 

num  =  num  +  1; 
continue; 
endi f ; 

if  PV_CT[  1  ]  <  PV_CTP [  num,  1  ]; 

flag  =  1; 
e  =  1 ; 

do  while  e  <=  4; 

if  W_CT[  e  ]  <  0; 
flag  =  -1; 
break ; 
endif ; 
e  =  e  +  1; 
endo  ; 

if  flag  ==  1; 

PV_CT  =  PV_CTP[  num,  .  ]; 

W_CTP  =  zeros (  9 ,  1  )  ; 

W_CTP[  PV_CT[  test_id  ]  ]  =  W_CT; 

endif ; 

endi f ; 

num  =  num  +  1; 
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}  =  selects  {  RV,  V  )  ? 


k  =  k  +  1; 
endo  ; 

j  =  j  +  1; 

endo  ; 

i  =  i  +  1; 
endo ; 

m  =  m  +  1; 
endo ; 

if  W_CTP*W_CTP*  ==  0; 

{  W_CTP,  PV_CT[  1  ] 
endif ; 

retpC  W_CTP,  PV_CT [  1  ]  ); 
endp ; 

proc  (  2  )  =  select_3 {  RV,  V  } ; 

local  WJ3TP,  W_CT,  PV_CTP ,  PV_CT,  id,  flag,  n,m,  i,  j  ,k,b, c,num,  e,test_id; 

test_id  ={234}; 
num  =1; 

PV_CTP  =  zeros (  130,  9  ); 

PV_CT  =  zeros  C  1 ,  9  } ; 

W_CTP  =  zeros {  9 ,  1  }  ; 
id  =  zeros (  1 ,  3  )  ; 

i  =  1; 

do  while  i  <=  7; 

j  -  i  +  1; 
do  while  j  <=  8; 
k  =  j  +  1; 
do  while  k  <=  9; 

id [  1  ]  =  i; 

id[  2  ]  =  j; 

id[  3  J  =  k; 

if  det {  RV[  id,  id  ]  )  ==  0; 
k  a  k  +  1; 
continue; 
endif; 

W_CT  =  inv(  RV[  id,  id  ]  )  *  V[  1,  id  ]  *  ; 

PV_CTP  [  num,  1  ]  =  sqrt{  V[  1,  id  3  *  W_CT)  ; 

PVJCTP[  num,  test_id  ]  =  id; 

if  num  ==  1; 

num  =  num  +  1; 
continue; 
endi f ; 

if  PV_CT[  1  1  <  FV_€TP[  num,  1  ]; 

flag  =  1; 
e  =  1; 

do  while  e  <=  3  ? 

if  W_CT [  e  ]  <  0; 
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flag  =  - 1 ; 
break; 
end if ; 
e  =  e  +  1; 
endo ; 

if  flag  ==  1; 

PV_CT  =  PV_CTP[  num,  .  ]; 

W_CTP  =  zeros (  9,  1  )  ; 

W_CTP[  PV_CT[  test^id  ]  ]  =  W_CT; 
endi f ; 

endif; 

num  =  num  +  1  ; 

k  =  k  +  1; 
endo ; 

j  =  j  +  l; 

endo ; 

i  =  i  +  1; 
endo ; 

if  W_CTP*W_CTP 1  ==  0; 

{  W_CTP,  PV__CT [  1  ]  }  =  select_3(  RV,  V  ); 
endif ; 

retp {  W_CTP,  PV_CT[  1]  ); 

endp ; 

proc  (  2  )  =  select_2 {  RV,  V  ) ; 

local  W__CTP,  W_CT,  PV_CTP ,  PV__CT ,  id,  flag,  nfm,  i,  j  ,k,b,  c,n\im#  e,test_id 

test_id  ={23}; 
num  =  1; 

PV_CTP  =  zeros (  130,  9  ); 

PV_CT  =  zeros (  1,  9  ); 

W_CTP  =  zeros (  9,  1  ); 
id  =  zeros (  1,  2  ) ; 

3=1; 

do  while  j  <=  8; 
k  =  j  +  1; 
do  while  k  <=  9; 


id [  1  ]  =  j ; 
id [  2  ]  =  k; 

if  det (  RV[  id,  id  ]  )  ==0; 
k  =  k  +  1; 
continue; 
endif ; 

W_CT  =  inv (  RV [  id,  id  3  )  *  V[  1,  id  ] ’ ? 
PV_CTP[  num,  1  ]  =  sqrt (  V[  1,  id  ]  *  W_CT)  ; 
PV_CTP[  num,  test_id  ]  =  id; 
if  num  ==  1; 
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num  =  num  +  1; 
continue; 
end if ; 

if  PV_€T [  1  ]  <  P¥_CTP[  num,  1  ]; 

flag  =  1; 
e  =  1; 

do  while  e  <=  2; 

if  W__CT  [  e  ]  <  0? 
flag  =  -1; 
break; 
endif ; 
e  =  e  +  1; 
endo ; 

if  flag  ==  1; 

PV_CT  =  PV_CTP [  num,  .  ] ; 
W_CTP  «  zeros {  9 ,  1  } ; 
W_CTP[  PV_CT[  test_id  ]  ] 
endif; 

endif; 

num  =  num  +  1; 

k  =  k  -i-  1; 
endo; 

j  =  3  +  1? 
endo; 

retpC  W_CTP,  PV_CT[  1  ]  ); 
endp ; 


/*  End  of  Step  3  */ 


=  W_CT; 


B-16 


APPENDIX  C:  BASIC  DESCRIPTIVES  AND  ASVAB  SUBTEST  VARIANCE- 
COVARIANCE  (VCV)  MATRICES  FOR  ARMY  INPUT  AND  YOUTH  POPULATIONS 
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Table  1 

Basic  Descriptives  for  ASVAB  Subtests  and  SQT  for  Army  Input  Population  (N  =  257,810) 
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37.89577453  23.35250004  -5.03994244  -1.39594372  44.80651289  22.49318756  41.75330783  68.89950588  23.56569266 

29.83954632  17.25495601  -0.53673611  3.59526961  17.90743269  18.22467046  22.60526383  23.56569266  31.20466676 


Table  3 

ASVAB  Subtest  Variance-Covariance  (VCV)  Matrix  for  1980  Youth  Population 
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APPENDIX  D:  CRITERION  RELIABILITIES  BY  MOS 


D-l 


Criterion  Reliabilities  (ryy)  by  MOS 


MOS 

_ % 

MOS 

ryy 

MOS 

rJ?  . . 

MOS 

*Vy 

11B 

0.860 

31V 

0.800 

63S 

0.840 

88H 

0.750 

1IC 

0.880 

35E 

0.830 

63T 

0.850 

88M 

0.870 

11H 

0.780 

35H 

0.830 

63W 

0.840 

88N 

0.840 

11M 

0.850 

35J 

0.830 

63Y 

0.840 

91A 

0.810 

12B 

0.850 

35N 

0,830 

67N 

0.840 

91D 

0.805 

12C 

0.820 

36M 

0.830 

67R 

0.840 

91E 

0.805 

12F 

0.850 

4 1C 

0.830 

67T 

0.840 

91F 

0.805 

13B 

0.830 

44B 

0.860 

67U 

0.840 

91G 

0.805 

13C 

0.845 

44E 

0.850 

67V 

0.910 

91K 

0.805 

13E 

0.845 

45B 

0.830 

67Y 

0.840 

91M 

0.805 

13F 

0.860 

45D 

0.830 

68B 

0.850 

91P 

0.805 

13M 

0.900 

45E 

0.840 

68D 

0.840 

91Q 

0.805 

13N 

0.770 

45K 

0.850 

68F 

0.840 

91R 

0.805 

13R 

0.850 

45L 

0.830 

68G 

0.830 

91S 

0.805 

14D 

0.770 

45N 

0.840 

68J 

0.880 

91T 

0.805 

15E 

0.805 

45T 

0.830 

68M 

0.830 

91Z 

0.805 

16E 

0.805 

46Z 

0.850 

68N 

0.800 

92A 

0.810 

161 

0.805 

51B 

0.850 

68Z 

0.830 

92G 

0.820 

16P 

0.770 

51K 

0.830 

71D 

0.870 

92M 

0.830 

16R 

0.770 

51M 

0.830 

71G 

0.840 

92R 

0.830 

16S 

0.770 

51R 

0.830 

71L 

0.850 

92Y 

0.890 

19D 

0.850 

5  IT 

0.805 

71M 

0.870 

93C 

0.805 

19E 

0.870 

52C 

0.830 

72E 

0.860 

93F 

0.830 

19K 

0.870 

52D 

0.850 

72G 

0.850 

93P 

0.805 

24Z 

0.830 

54B 

0.790 

73C 

0,800 

95B 

0.800 

25M 

0.720 

55B 

0.880 

73D 

0.840 

95C 

0.805 

25S 

0.820 

55D 

0.830 

74B 

0.770 

96B 

0.805 

25Z 

0.805 

55G 

0.830 

75B 

0.800 

96D 

0.805 

27E 

0.830 

57E 

0.830 

75C 

0.840 

96R 

0.805 

27Z 

0.830 

62B 

0.900 

75D 

0.780 

97B 

0.830 

29V 

0.850 

62E 

0.790 

75E 

0.840 

97E 

0.805 

29Z 

0.830 

62F 

0.830 

75F 

0.840 

98C 

0.805 

3 1C 

0.850 

62J 

0,790 

76J 

0.840 

98G 

0.805 

31K 

0.790 

63B 

0.830 

76P 

0.840 

98H 

0.805 

31L 

0.880 

63D 

0.840 

76V 

0.840 

98Z 

0.805 

31N 

0.830 

63E 

0.740 

76X 

0.840 

31P 

0.830 

63G 

0.850 

77F 

0.850 

31Q 

0.830 

63H 

0.840 

77W 

0.830 

31R 

0.830 

63J 

0.840 

81L 

0.805 

31S 

0.830 

63N 

0.840 

82C 

0.805 
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APPENDIX  E:  ACQUISITION  AND  OBSERVED  ms  BY  MOS 


E-l 


Acquisition  and  Observed  ns  by  MOS 


MOS 

Acquisition 

n 

Observed 

n 

MOS 

Acquisition 

n 

Observed 

n 

11B 

13310 

5000 

45D 

123 

565 

lie 

1993 

5000 

45E 

225 

546 

11H 

2118 

5000 

45K 

199 

817 

11M 

338 

4593 

45L 

105 

448 

12B 

3560 

5000 

45N 

45 

563 

12C 

436 

1950 

45T 

249 

509 

12F 

234 

603 

46Z 

135 

498 

13B 

4442 

5000 

51B 

297 

2037 

13G 

141 

720 

51K 

61 

532 

13E 

632 

1919 

51M 

28 

327 

13F 

1274 

4101 

51R 

77 

723 

13M 

657 

ne 

5  IT 

26 

344 

13N 

328 

2724 

52C 

322 

529 

13R 

166 

592 

52D 

1233 

5000 

14D 

30 

683 

54B 

1152 

1380 

15E 

408 

224 

55B 

629 

2457 

16E 

356 

703 

55D 

81 

415 

16J 

118 

171 

55G 

110 

215 

16P 

906 

1104 

57E 

122 

791 

16R 

1157 

1996 

62B 

460 

3054 

16S 

1880 

2406 

62E 

504 

1522 

19D 

5536 

5000 

,62F 

200 

527 

19E 

232 

4764 

62J 

406 

887 

19K 

31 

5000 

63B 

3250 

5000 

24Z 

192 

752 

63D 

359 

1234 

25M 

23 

451 

63E 

562 

1376 

25S 

16 

358 

63G 

96 

785 

25Z 

61 

372 

63H 

547 

2396 

27E 

282 

898 

63J 

383 

1302 

27Z 

266 

548 

63N 

116 

750 

29V 

47 

852 

63S 

1056 

2506 

29Z 

222 

433 

63T 

868 

3378 

31C 

1723 

5000 

63W 

1105 

3062 

31K 

1744 

5000 

63Y 

364 

987 

31L 

914 

2778 

67N 

374 

1359 

31N 

267 

709 

67R 

286 

236 

3  IP 

173 

563 

67T 

415 

1564 

31Q 

423 

1394 

67U 

268 

1632 

31R 

1810 

5000 

67V 

178 

1751 

31S 

160 

498 

67Y 

303 

1168 

31V 

1001 

4278 

68B 

65 

640 

35E 

192 

1021 

68D 

84 

740 

35H 

75 

307 

68F 

81 

712 

35J 

161 

1034 

68G 

148 

904 

35N 

218 

737 

68J 

258 

1128 

36M 

223 

1201 

68M 

90 

388 

41C 

48 

323 

68N 

46 

475 

44B 

305 

1045 

68Z 

18 

749 

44E 

73 

592 

71D 

240 

1431 

45B 

93 

612 

71G 

181 

1145 

E-2 


Acquisition  and  Observed  ns  by  MOS  (con) 


MOS 

Acquisition 

n 

Observed 

n 

MOS 

Acquisition 

n 

Observed 

n 

71L 

1325 

5000 

91K 

209 

1478 

71M 

214 

972 

91M 

93 

513 

72E 

799 

1651 

91P 

76 

695 

72G 

572 

1738 

91Q 

83 

682 

73C 

275 

2246 

91R 

113 

558 

73D 

94 

500 

91S 

119 

514 

74B 

105 

1184 

91T 

76 

345 

75B 

796 

4113 

91Z 

169 

641 

75C 

148 

2505 

92A 

2336 

5000 

75D 

115 

2714 

92G 

3002 

5000 

75E 

211 

1379 

92M 

33 

298 

75F 

163 

624 

92R 

296 

1009 

76  J 

71 

997 

92Y  | 

2031 

5000 

76P 

671 

2897 

93C 

278 

626 

76V 

1267 

5000 

93F 

90 

303 

76X 

228 

541 

93P 

220 

1327 

77F 

1326 

5000 

95B 

4187 

5000 

77W 

71 

805 

95C 

87 

323 

81L 

42 

331 

96B 

486 

818 

82C 

461 

808 

96D 

180 

361 

88H 

409 

1525 

96R 

257 

792 

88M 

4504 

5000 

97B 

347 

429 

88N 

99 

1954 

97E 

323 

372 

91A 

4601 

5000 

98C 

840 

562 

91D 

185 

748 

98G 

1309 

1242 

91E 

223 

1209 

98H 

177 

966 

91F 

57 

474 

98Z 

461 

463 

91G 

73 

309 

Note .  Acquisition  numbers  (N)  based  on  1989  Seabrook  Reports .  Observed  N  computed  from  SQT  database 
(N  -  257,810)  used  by  Zeidner,  Johnson ,  and  colleagues  (2000),  also  used  in  current  replication. 
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APPENDIX  F:  RESULTS  OF  REPLICATION 
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Table  1 

Population  Beta  Weights  Corrected  to  the  1980  Youth  Population  by  Army  Aptitude  (AA)  Composite  (9  Job  Families) 
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Table  2 

Operational  Weights  and  Constants  for  Computing  Army  Aptitude  (AA)  Standard  Scores  by  AA  Composite  (9  Job  Families) 
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Table  3 

Population  Beta  Weights  Corrected  to  the  1980  Youth  Population  by  Army  Aptitude  (AA)  Composite  (17  Job  Families) 
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Table  4 

Operational  Weights  and  Constants  for  Computing  Army  Aptitude  (AA)  Standard  Scores  by  AA  Composite  (17  Job  Families) 
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Table  5 

Population  Beta  Weights  Corrected  to  the  1980  Youth  Population  by  Job  Family  (150  Job  Families) 
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Operational  Weights  and  Constants  for  Computing  Army  Aptitude  (AA)  Scores  by  AA  Composite  (150  Job  Families) 
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Knowledge;  El  =  Electronics  Information;  VE  =  Verbal. 


